-- Logs begin at Mon 2022-08-29 18:12:54 UTC, end at Mon 2022-08-29 19:48:09 UTC. -- Aug 29 19:11:26.999717 dv-cinder-855013-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 19:11:27.010633 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 19:11:27 2022] *** Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: nodename: dv-cinder-855013-1-iscsi Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: machine: x86_64 Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: clock source: unix Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: pcre jit disabled Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: detected number of CPU cores: 4 Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: current working directory: / Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: detected binary path: /usr/bin/uwsgi-core Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: your processes number limit is 47680 Aug 29 19:11:27.012693 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: your memory page size is 4096 bytes Aug 29 19:11:27.013528 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: detected max file descriptor number: 2048 Aug 29 19:11:27.013528 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: lock engine: pthread robust mutexes Aug 29 19:11:27.013528 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: thunder lock: enabled Aug 29 19:11:27.013528 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 19:11:27.013528 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 19:11:27.051684 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: Python main interpreter initialized at 0x5622521da9c0 Aug 29 19:11:27.051684 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: python threads support enabled Aug 29 19:11:27.051684 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: your server socket listen backlog is limited to 100 connections Aug 29 19:11:27.051684 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: your mercy for graceful operations on workers is 90 seconds Aug 29 19:11:27.052131 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 19:11:27.052131 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: *** Operational MODE: preforking *** Aug 29 19:11:27.052415 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: *** uWSGI is running in multiple interpreter mode *** Aug 29 19:11:27.052415 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: spawned uWSGI master process (pid: 106275) Aug 29 19:11:27.052637 dv-cinder-855013-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 19:11:27.053227 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: spawned uWSGI worker 1 (pid: 106276, cores: 1) Aug 29 19:11:27.053566 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: spawned uWSGI worker 2 (pid: 106277, cores: 1) Aug 29 19:11:27.053779 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 19:11:27.732068 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:11:27.732941 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:11:28.840731 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:11:28.840731 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: from cryptography.utils import int_from_bytes Aug 29 19:11:28.841402 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:11:28.841402 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: from cryptography.utils import int_from_bytes Aug 29 19:11:28.841635 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:11:28.841635 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: from cryptography.utils import int_from_bytes Aug 29 19:11:28.842113 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:11:28.842113 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: from cryptography.utils import int_from_bytes Aug 29 19:11:31.387903 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:11:31.388575 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:11:31.388672 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:11:31.388969 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:11:31.389191 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:11:31.389562 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:11:31.389656 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:11:31.389736 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.389914 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.390006 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:11:31.390237 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.390325 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:11:31.390559 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.390647 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:11:31.390893 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391002 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391212 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391306 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391533 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391632 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391869 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.391971 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.392210 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.392307 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.392473 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.392559 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.392789 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.392874 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.393117 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-1-iscsi {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.393232 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.393445 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.393583 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.393742 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.393877 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394049 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394144 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394365 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-1-iscsi {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394668 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394754 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.394994 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.395107 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.395302 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.395407 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.395633 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.395903 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.396306 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.396306 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.396535 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.396657 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.396769 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.396927 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.397068 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.397269 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.397399 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.397585 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.397672 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.398502 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.398649 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.398854 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.398954 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.399173 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.399330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.399484 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.399660 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.399868 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400074 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400261 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400355 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-1-iscsi {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400521 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400602 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400836 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.400933 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.401146 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.401283 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-1-iscsi {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.401534 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.401664 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.401878 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.401992 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.402182 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.402286 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.402504 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.402599 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.402828 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.402924 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.403133 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.403219 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.403463 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.403560 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.403785 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.403908 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.404132 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.404220 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.404460 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.404608 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.404763 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.404865 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.405074 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.405187 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.405382 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.405509 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.405699 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.405795 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406004 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406106 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406411 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406560 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406649 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406868 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.406955 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.407191 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.407279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.407443 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.407537 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.407754 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.407842 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408089 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408176 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408349 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408474 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408667 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408768 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.408985 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409072 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409238 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409326 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409559 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409658 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409878 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.409965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.410186 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.410282 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.410496 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.410583 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.410829 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.410924 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.411107 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.411193 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.411413 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.411501 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.411723 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.411811 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412060 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412367 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412456 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412682 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412781 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.412993 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.413090 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.413320 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.413416 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.414164 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.414264 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.414497 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.414581 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415033 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415136 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415346 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415450 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415711 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415807 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.415994 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.416092 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.416322 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.416410 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.416629 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.416730 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.416934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417021 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417245 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417333 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417554 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417654 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417885 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.417972 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.418187 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.418272 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.418439 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.418536 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.418739 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.418826 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419045 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419134 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419341 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419429 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419642 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419729 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.419974 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.420066 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.420283 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.420372 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.420607 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.420701 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421068 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421187 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421285 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421368 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421491 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421610 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421804 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.421894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.422112 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.422208 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.422415 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.422510 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.422721 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.422818 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423025 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423110 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423328 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423416 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423646 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423740 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.423990 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424081 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424299 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424384 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424625 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424784 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424911 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.424999 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.425218 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.425319 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.425539 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.425705 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.425844 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.425930 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.426148 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.426241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.426467 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.426560 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.426768 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.426853 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.427074 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.427169 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.427389 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.427489 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.427695 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.427779 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428028 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428117 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428349 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428448 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428660 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428745 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.428971 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.429059 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.429327 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.429468 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.429637 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.429794 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.429940 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.430131 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.430245 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.430453 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.430538 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.430766 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.430853 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.431100 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.431278 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.431404 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.431491 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.431710 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.431796 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432035 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432134 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432345 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432430 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432649 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432734 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.432954 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433049 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433255 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433341 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433561 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433677 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.433971 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.434182 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.434267 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.434528 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.434628 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.434870 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.434964 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.435187 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.435281 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:11:31.435590 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.435690 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.435873 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.435964 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.436190 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.436277 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.436503 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.436596 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.436818 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.436905 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.437144 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.437229 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.437454 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.437553 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.437765 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.437851 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.438076 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.438170 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.438396 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.438489 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.438716 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.438802 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.439046 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.439131 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.439367 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.439476 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.439683 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.439769 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440034 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440135 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440346 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440440 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440666 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440752 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.440980 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.441064 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.441301 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.441393 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.441610 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.441695 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.441930 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.442016 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.442269 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.442365 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.442595 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.442692 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.442915 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.443148 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.443257 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.443327 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.443638 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.443731 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.443975 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.444063 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.444288 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.444375 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.444613 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.444700 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.444955 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445171 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445457 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445565 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445666 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445892 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.445989 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.446231 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.446317 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.446547 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.446632 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.446852 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.446945 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.447165 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.447251 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.447474 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.447566 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.447782 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.447982 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.448167 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.448267 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.448485 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.448579 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.448800 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.448971 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.449131 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.449216 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.449446 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.449538 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.449763 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.449860 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.450077 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.450164 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.450391 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.450475 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.450703 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.450800 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451012 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451108 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451320 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451409 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451634 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451728 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.451972 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.452063 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.452279 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.452385 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.452597 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.452697 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.452926 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453011 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453234 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453329 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453573 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453695 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453878 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.453972 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.454188 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.454278 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.454498 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.454588 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.454807 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.454897 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.455118 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.455234 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.455427 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.455514 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.455736 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.455998 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456094 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456188 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456379 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456469 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456688 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456776 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.456995 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.457096 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.457322 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.457415 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.457629 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.457712 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.457939 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.458048 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.458326 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.458953 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.458953 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.459930 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.460223 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.460362 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.460972 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461066 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461152 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461222 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461298 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461367 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461367 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461513 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461580 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461645 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461720 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461797 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461865 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.461931 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462004 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462071 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462146 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462475 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462655 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462793 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.462934 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463083 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463175 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463358 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463487 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463574 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463736 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.463833 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464072 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464157 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464376 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464461 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464681 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464780 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.464985 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465070 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465287 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465372 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465590 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465685 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465892 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.465978 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.466217 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.466305 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.466543 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.466632 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.466854 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.466942 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.467161 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.467248 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.467466 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.467587 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.467772 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.467946 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.468139 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.468262 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.468445 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.468571 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.468794 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.468893 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.469126 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.469212 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.469448 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.469544 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.469771 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.469857 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.470084 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.470178 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.470400 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.470487 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.470709 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.470802 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471022 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471121 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471336 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471422 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471647 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471736 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.471992 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.472136 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.472308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.472398 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.472646 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.472734 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.472953 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.473046 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.473300 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.473395 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.473634 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.473801 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.473961 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.474179 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.474386 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.474577 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.474751 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.474937 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475108 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475256 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475354 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475488 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475643 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475785 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.475951 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.476118 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.476896 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477108 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477251 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477402 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477549 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477695 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477844 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.477980 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478124 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478262 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478411 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478547 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478681 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478820 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.478958 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.479173 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.479322 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.479458 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.479598 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.479730 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.479891 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.480063 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.480202 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.480348 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.480513 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.480658 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.481089 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.481244 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.481401 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.481572 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.481729 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.481866 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482049 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482196 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482343 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482477 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482664 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482805 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.482985 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.483121 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.483296 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.483441 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.483607 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.483739 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.483939 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484078 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484248 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484392 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484553 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484689 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484862 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.484997 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.485172 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.485304 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.485476 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.485619 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.485768 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.485900 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.486097 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.486233 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.486413 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.486515 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.486721 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.486817 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487024 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487124 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487323 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487422 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487634 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487731 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.487979 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.488072 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.488285 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.488388 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.488589 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.488687 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.488911 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489003 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489218 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489319 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489523 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489611 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489847 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.489936 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.490158 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.490255 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.490466 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.490554 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.490772 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.490859 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.491079 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.491168 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.491420 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.491510 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.491771 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.491876 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.492108 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.492216 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.492419 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.492508 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.492879 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.493193 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.493357 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.493510 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.493758 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.493856 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.494118 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.494437 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.494698 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.494791 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.495115 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.495221 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.495398 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.495502 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.495743 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.495840 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.496058 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.496208 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.496377 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.496465 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.496765 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.496855 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497040 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497204 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497338 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497491 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497632 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497768 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.497901 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.498035 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.498205 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.498366 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.498509 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.498608 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.498821 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.499087 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.499246 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.499421 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.499556 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.499739 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.499911 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.500092 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.500244 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.500395 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.500532 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.500726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.500860 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.501047 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.501193 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.501373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.501625 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.501761 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.501970 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.502118 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.502281 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.502425 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.502568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.502715 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.502867 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503048 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503185 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503487 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503631 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503764 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.503972 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.504065 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.504292 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.504470 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.504603 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.504693 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505133 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505288 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505380 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505471 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505553 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505633 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505825 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.505922 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.506130 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.506229 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.506434 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.506520 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.506736 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.506841 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507076 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507221 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507388 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507522 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507668 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507806 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.507985 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.508119 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.508259 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.508416 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.508601 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.508741 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.508890 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509026 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509205 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509341 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509511 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509655 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509837 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.509972 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.510149 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.510283 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.510433 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.510579 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.510745 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.510882 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511050 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511182 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511355 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511457 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511648 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511782 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.511977 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.512117 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.512272 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.512418 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.512577 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.512726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.512891 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513025 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513202 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513337 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513509 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513659 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513816 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.513958 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.514104 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.514249 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.514402 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.514538 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.514700 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.514834 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515015 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515150 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515323 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515458 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515627 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515777 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.515987 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516127 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516286 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516421 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516554 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516699 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516843 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.516977 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.517184 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.517329 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.517472 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.517567 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.517743 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.517833 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518051 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518138 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518356 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518454 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518660 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518749 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.518968 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.519063 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.519277 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.519373 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.519580 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.519668 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.519912 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.520005 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.520227 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.520317 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.520585 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.520817 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.520912 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.521534 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.521534 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.521702 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.521782 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.521861 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.521946 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522090 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522186 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522274 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522394 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522484 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522712 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.522814 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.523545 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.523635 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.523869 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.523960 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.524182 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.524284 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.524485 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.524582 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.524788 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.524876 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.525097 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.525195 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.525398 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.525486 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.525698 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.525786 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526000 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526104 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526302 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526391 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526641 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526728 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.526950 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.527040 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.527260 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.527397 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.527561 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.527664 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.527912 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528020 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528191 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528288 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528499 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528628 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.528897 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.529111 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.529199 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.529500 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.529619 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.529751 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.529852 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530062 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530150 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530369 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530467 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530675 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530762 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.530982 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.531069 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.531281 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.531378 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.531644 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.531755 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.531965 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.532152 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.532282 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.532465 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.532585 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.532785 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.532875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.533108 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.533196 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.533425 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.533517 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.533746 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.533835 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534061 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534149 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534368 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534458 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534686 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534774 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.534990 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.535091 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.535299 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.535397 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.535603 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.535690 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.535933 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.536035 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.536346 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.536446 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.536667 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.536917 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.537005 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.537278 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.537389 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.537594 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.537782 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.537904 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.538217 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.538314 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.538571 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.539331 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.539430 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.539672 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.539837 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.540007 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.540315 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.540404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.540627 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.540769 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.540931 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.541181 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.541279 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.541505 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.541593 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.541823 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.541921 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.542132 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.542220 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.542453 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.542547 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.542773 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.542872 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.543092 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.543180 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.543411 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.543508 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.543732 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.543824 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544066 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544166 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544378 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544472 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544687 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544775 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.544994 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.545082 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.545313 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.545401 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.545729 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.545834 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.545961 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546061 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546272 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546360 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546588 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546686 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546887 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.546975 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.547198 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.547318 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.547520 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.547634 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.547918 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548020 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548230 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548334 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548537 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548628 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548890 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.548997 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.549194 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.549327 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.549516 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.549650 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.549933 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.550022 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.550244 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.550370 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.550550 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.550688 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.550966 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.551055 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.551276 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.551374 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.551585 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.551673 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.551916 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552017 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552236 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552331 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552555 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552658 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552860 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.552949 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.553167 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.553265 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.553471 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.553558 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.553793 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.553881 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.554098 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.554210 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.554436 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.554535 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.554749 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.554839 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.555052 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.555140 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.555375 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.555466 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.555696 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.555914 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.556038 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.556206 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.556360 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.556520 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.556771 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.556868 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.557094 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.557198 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.557407 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.557505 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.557728 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.557921 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.558051 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.558151 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.558355 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.558446 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.558658 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.558748 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.559022 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.559307 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.559522 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.559717 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.559961 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.560285 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.560285 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561145 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561254 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561340 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561431 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561520 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561611 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561693 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561780 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561868 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.561868 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562023 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562114 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562195 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562275 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562342 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562419 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562497 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562690 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.562819 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.563001 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.563135 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.563323 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.563445 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.563643 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.563746 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564003 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564096 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564329 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564434 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564636 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564732 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.564942 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565040 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565243 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565341 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565546 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565646 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565887 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.565977 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.566192 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.566291 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.566493 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.566580 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.566819 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.566907 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.567124 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.567215 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.567439 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.567528 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.567754 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.567875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.568118 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.568217 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.568450 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.568547 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.568758 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.568847 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.569086 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.569187 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.569398 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.569488 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.569699 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.569795 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570001 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570089 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570305 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570403 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570610 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570706 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.570917 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571006 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571225 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571316 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571530 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571629 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571833 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.571962 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.572166 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.572256 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.572490 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.572589 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.572796 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.572893 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.573121 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.573210 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.573429 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.573528 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.573735 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.573824 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.574559 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.574658 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.574895 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.574994 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.575236 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.575327 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.575540 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.575631 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.575887 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.575981 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.576202 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.576304 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.576514 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.576653 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.576824 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.576915 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.577130 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.577226 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.577436 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.577526 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.577745 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.577841 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578106 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578206 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578364 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578467 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578675 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578764 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.578979 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.579066 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.579283 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.579379 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.579590 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.579681 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.579940 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.580047 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.580255 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.580495 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.580686 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.580826 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.580999 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.581138 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.581330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.581451 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.581654 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.581745 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.581974 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.582071 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.582298 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.582390 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.582618 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.582710 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.582938 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583027 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583272 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583372 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583646 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583742 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583905 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.583988 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.584211 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.584306 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.584531 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.584621 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.584852 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.584956 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.585239 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.585451 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.586092 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.586275 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.586582 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.586702 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.586886 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.586959 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.587125 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.587247 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.587443 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.587567 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.587753 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.587907 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.588092 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.588272 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.588409 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.588535 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.588726 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.588847 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589043 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589159 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589356 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589493 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589671 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589819 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.589983 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.590149 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.590319 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.590488 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.590578 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.590807 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.590897 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.591125 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.591216 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.591445 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.591544 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.591762 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.591880 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.592147 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.592245 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.592492 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.592594 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.592819 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.592927 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.593093 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.593189 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.593425 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.593614 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.593743 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.593931 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.594059 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.594267 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.594408 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.594595 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.594685 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.594922 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595019 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595239 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595556 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595658 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595891 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.595993 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.596206 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.596294 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.596511 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.596618 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.596820 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.596909 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.597192 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.597299 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.597431 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.597532 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.597751 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.597841 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.598061 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.598159 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.598369 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.598616 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.598737 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.598937 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.599049 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.599276 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.599503 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.599606 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.599956 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.600058 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.600303 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.600390 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.600635 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.600726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.600971 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.601068 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.601313 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.601418 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.601625 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.601715 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.601953 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602047 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602265 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602372 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602584 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602673 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602879 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.602966 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.603190 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.603288 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.603496 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.603585 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.603802 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.603911 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.604143 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.604253 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.604452 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.604748 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.604838 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.605053 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.605164 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.605357 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.605447 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.605684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606035 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606258 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606370 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606562 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606652 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606866 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.606954 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.607179 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.607284 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.607483 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.607579 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.607787 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.607910 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.608120 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.608238 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.608441 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.608593 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.608736 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.608828 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.609140 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.609258 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.609398 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.609479 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.609702 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.609842 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610005 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610154 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610292 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610440 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610601 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610742 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.610926 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611065 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611236 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611375 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611561 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611695 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611891 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.611985 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.612198 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.612287 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.612501 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.612589 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.612814 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.612907 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.613120 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.613211 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.613424 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.613521 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.613735 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.613832 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.614043 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.614131 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.614353 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.614603 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.615220 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.615516 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.615920 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.616211 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.616431 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.617174 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.617377 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.617377 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.617709 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.617792 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.618214 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.618463 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.618824 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619071 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619310 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619517 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619611 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619710 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619794 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619905 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.619977 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620056 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620154 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620237 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620306 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620384 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620464 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620556 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620647 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620647 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620802 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620882 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.620961 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621047 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621206 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621358 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621358 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621499 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621586 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621676 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621758 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621837 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621915 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.621994 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.622177 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.622275 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.622521 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.622620 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.622837 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.622934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.623150 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.623254 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.623461 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.623548 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.623770 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.623882 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.624104 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.624194 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.624411 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.624500 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.624719 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.624807 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625026 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625123 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625336 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625433 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625664 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625762 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.625975 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.626072 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.626275 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.626363 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.626603 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.626699 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.626961 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.627067 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.627226 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.627357 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.627630 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.627744 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.627944 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628040 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628269 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628361 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628587 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628726 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628899 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.628987 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.629208 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.629305 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.629530 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.629636 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.629827 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.629917 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.630140 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.630229 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.630504 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.630606 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.630801 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.630890 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.631112 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.631199 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.631418 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.631508 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.631772 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.631876 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.632347 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.632950 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633110 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633263 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633408 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633558 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633688 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633783 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633867 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.633974 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.634140 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.634317 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.634472 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.634729 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.634819 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635058 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635156 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635360 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635449 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635670 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635760 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.635998 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.636093 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.636304 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.636407 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.636607 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.636752 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.636910 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.637095 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.637214 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.637432 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.637530 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.637766 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.637855 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.638144 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.638248 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.638400 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.638480 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.638704 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.638800 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639007 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639106 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639399 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639618 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639705 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.639951 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640055 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640259 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640348 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640565 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640654 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640871 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.640970 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.641183 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.641271 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.641497 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.641585 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.641819 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.641917 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.642122 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.642210 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.642428 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.642516 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.642733 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.642831 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643043 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643150 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643359 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643449 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643667 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643765 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.643998 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.644104 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.644306 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.644395 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.644617 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.644716 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.644926 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645023 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645254 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645344 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645582 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645672 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645886 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.645983 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.646213 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.646302 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.646534 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.646624 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.646853 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.646950 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.647166 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.647263 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.647478 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.647619 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.647925 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.648034 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.648250 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.648349 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.648565 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.648657 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.648875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649010 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649188 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649287 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649499 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649588 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649815 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.649904 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.650126 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.650217 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.650437 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.650560 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.650902 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651009 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651103 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651184 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651420 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651509 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651745 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.651834 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.652082 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.652181 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.652408 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.652497 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.652728 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.652841 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.653053 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.653151 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.653369 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.653459 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.653701 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.653800 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654017 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654107 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654330 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654419 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654640 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654742 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.654940 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.655027 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.655213 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:11:31.655313 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.655817 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.656025 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.656365 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.656689 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.657100 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.657366 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.657698 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.658013 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.658346 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.658679 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.659035 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.659350 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.659698 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.660084 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.660434 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.660747 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.661061 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:11:31.661330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:11:31.811102 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO dbcounter [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Registered counter for database nova_api Aug 29 19:11:31.820355 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO dbcounter [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Registered counter for database nova_api Aug 29 19:11:31.831046 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_db.sqlalchemy.engines [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:31.838009 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writer thread running {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:31.841567 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:31.848412 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:31.896363 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.context [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2b8211c-8acf-4e46-aadb-2cdee030a23c(cell1) {{(pid=106276) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:11:31.901097 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_concurrency.lockutils [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:31.901584 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_concurrency.lockutils [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:31.903162 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_concurrency.lockutils [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.903932 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_concurrency.lockutils [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:31.904372 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_concurrency.lockutils [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:31.906340 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_concurrency.lockutils [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.907309 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.context [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2b8211c-8acf-4e46-aadb-2cdee030a23c(cell1) {{(pid=106277) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:11:31.908351 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO dbcounter [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Registered counter for database nova_cell0 Aug 29 19:11:31.911216 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:31.911720 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:31.912574 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO dbcounter [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Registered counter for database nova_cell1 Aug 29 19:11:31.913451 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.914742 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:31.915204 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:31.919589 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.919589 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO dbcounter [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Registered counter for database nova_cell0 Aug 29 19:11:31.920439 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_db.sqlalchemy.engines [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:31.922688 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_db.sqlalchemy.engines [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:31.923660 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO dbcounter [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Registered counter for database nova_cell1 Aug 29 19:11:31.928140 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writer thread running {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:31.931463 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writer thread running {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:31.931997 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:31.934120 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:31.939609 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:31.941973 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:32.081175 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO dbcounter [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Registered counter for database nova_cell0 Aug 29 19:11:32.090662 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG oslo_db.sqlalchemy.engines [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:32.091041 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO dbcounter [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Registered counter for database nova_cell0 Aug 29 19:11:32.095145 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writer thread running {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:32.097942 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_db.sqlalchemy.engines [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:11:32.102976 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writer thread running {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:11:32.518809 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: WARNING keystonemiddleware.auth_token [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:11:32.527180 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: WARNING keystonemiddleware.auth_token [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:11:32.539254 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:11:32.546600 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:11:32.899944 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:11:32.900137 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: WARNING keystonemiddleware.auth_token [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:11:32.905798 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: WARNING keystonemiddleware.auth_token [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:11:32.905917 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: WARNING keystonemiddleware.auth_token [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:11:32.911067 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622521da9c0 pid: 106276 (default app) Aug 29 19:11:32.911216 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622521da9c0 pid: 106277 (default app) Aug 29 19:11:32.913224 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:32.914550 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-a577f6d8-065b-4064-b171-0573b32dccea None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001859 Aug 29 19:11:32.914962 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Mon Aug 29 19:11:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:02.439634 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:02.441927 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002688 Aug 29 19:13:02.442701 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:02.460236 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_api:SELECT=3 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:02.461194 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_cell0:SELECT=3 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:02.462412 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_cell1:SELECT=3 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:02.463251 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:03.618951 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-874e16d0-d9d9-46ad-b3a6-1b9bc3255e88 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:03.659376 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-874e16d0-d9d9-46ad-b3a6-1b9bc3255e88 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.208801 Aug 29 19:13:03.660738 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 19:13:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:06.226943 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:06.228206 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-169f0997-dbfa-44dd-955b-ff389f166402 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Aug 29 19:13:06.229241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 2/4] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:06.818309 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-db4e8393-4315-43b6-a898-3c415b310473 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "disk": 1, "ram": 256, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:06.938574 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-db4e8393-4315-43b6-a898-3c415b310473 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.700209 Aug 29 19:13:06.939504 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 3/5] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:06.955261 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:06.956639 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell0:SELECT=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:06.959394 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell1:SELECT=3 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:06.960197 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:07.188719 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-a46d6152-e30a-46fb-be31-0e0708493cc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:07.336360 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-a46d6152-e30a-46fb-be31-0e0708493cc1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387061 Aug 29 19:13:07.337425 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 3/6] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 19:13:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:09.846577 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-db4e8393-4315-43b6-a898-3c415b310473 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:09.847696 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-db4e8393-4315-43b6-a898-3c415b310473 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 29 19:13:09.848211 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 4/7] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:10.688413 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-877c330f-7fb7-4526-9939-09eb3dc805cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "vcpus": 1, "id": "d1", "ram": 512}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:10.856936 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-877c330f-7fb7-4526-9939-09eb3dc805cf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.000930 Aug 29 19:13:10.858060 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 4/8] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:13:10.871235 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-ce295648-fc7e-4a91-b36c-a5e1d93aad35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:11.024745 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-ce295648-fc7e-4a91-b36c-a5e1d93aad35 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157335 Aug 29 19:13:11.035055 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 5/9] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 19:13:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:13.557274 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-877c330f-7fb7-4526-9939-09eb3dc805cf admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:13.558190 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-877c330f-7fb7-4526-9939-09eb3dc805cf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 29 19:13:13.558592 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:14.000838 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-62a13965-9dc7-4ef1-971a-a04f017c3126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:14.149793 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-62a13965-9dc7-4ef1-971a-a04f017c3126 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.585037 Aug 29 19:13:14.150353 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 6/11] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:14.163514 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-3c3a906c-fae0-46da-804f-7fa016bd8af7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:14.495554 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-3c3a906c-fae0-46da-804f-7fa016bd8af7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.336427 Aug 29 19:13:14.496173 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 6/12] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 19:13:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:16.915802 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-62a13965-9dc7-4ef1-971a-a04f017c3126 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:16.916898 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-62a13965-9dc7-4ef1-971a-a04f017c3126 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 29 19:13:16.917299 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 7/13] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:17.369940 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-07d3fc76-a3d5-4825-9e5f-507961fd0d50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:17.521954 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-07d3fc76-a3d5-4825-9e5f-507961fd0d50 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.598372 Aug 29 19:13:17.522687 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 7/14] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:17.534915 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-3f4849f4-ffc9-4192-97c7-5cac504edafc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:17.673646 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-3f4849f4-ffc9-4192-97c7-5cac504edafc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142364 Aug 29 19:13:17.676774 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 8/15] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 19:13:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:20.252134 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-07d3fc76-a3d5-4825-9e5f-507961fd0d50 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:20.253350 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-07d3fc76-a3d5-4825-9e5f-507961fd0d50 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 29 19:13:20.253829 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 8/16] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:20.703814 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-b8e7eec9-2cd3-4c0c-8bee-f932800bfcbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:20.829479 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-b8e7eec9-2cd3-4c0c-8bee-f932800bfcbf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.568703 Aug 29 19:13:20.830056 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 9/17] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:20.842478 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-416a07e7-9c41-4d79-ba18-19de337d62cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:20.948184 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-416a07e7-9c41-4d79-ba18-19de337d62cf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105397 Aug 29 19:13:20.948184 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 9/18] 10.222.0.62 () {64 vars in 1336 bytes} [Mon Aug 29 19:13:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:23.870160 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-b8e7eec9-2cd3-4c0c-8bee-f932800bfcbf admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:23.871572 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-b8e7eec9-2cd3-4c0c-8bee-f932800bfcbf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Aug 29 19:13:23.872164 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 10/19] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:24.388050 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-6ce3f876-fcc4-49a4-af93-d5757ce6318e admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:24.415049 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-6ce3f876-fcc4-49a4-af93-d5757ce6318e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.534574 Aug 29 19:13:24.415588 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 10/20] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 19:13:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:27.429611 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-b8e7eec9-2cd3-4c0c-8bee-f932800bfcbf admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:27.430605 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-b8e7eec9-2cd3-4c0c-8bee-f932800bfcbf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 29 19:13:27.431003 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 11/21] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:27.876153 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-2277e5ec-db84-4919-9738-9f88085b7915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "swap": 0}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:28.012037 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-2277e5ec-db84-4919-9738-9f88085b7915 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.574192 Aug 29 19:13:28.012497 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 11/22] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:28.025518 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-0a78e2cc-b929-4626-96cb-bca6726923dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:28.205343 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-0a78e2cc-b929-4626-96cb-bca6726923dc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.183703 Aug 29 19:13:28.205930 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 12/23] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 19:13:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:30.615382 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-2277e5ec-db84-4919-9738-9f88085b7915 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:30.616293 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-2277e5ec-db84-4919-9738-9f88085b7915 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 29 19:13:30.616692 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:31.060925 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-640b5232-e45a-4d56-a5d1-4f23df88b1ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "id": "2"}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:31.200578 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-640b5232-e45a-4d56-a5d1-4f23df88b1ab admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.577380 Aug 29 19:13:31.201162 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 13/25] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:13:31.213298 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-0285ccdd-9feb-4b09-b454-7790e1f13e37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:31.327983 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-0285ccdd-9feb-4b09-b454-7790e1f13e37 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117967 Aug 29 19:13:31.328666 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 13/26] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 19:13:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:33.795013 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-640b5232-e45a-4d56-a5d1-4f23df88b1ab admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:33.796056 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-640b5232-e45a-4d56-a5d1-4f23df88b1ab admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 29 19:13:33.796960 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:34.261237 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-71ba6b61-9cd3-4f3a-a773-287c6ebfae2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "swap": 0, "id": "3"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:34.794895 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-71ba6b61-9cd3-4f3a-a773-287c6ebfae2a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.990633 Aug 29 19:13:34.795452 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 14/28] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:34.808437 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-db26b3c3-e06c-4054-8f10-363283f3ac63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:34.817382 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:34.976821 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-db26b3c3-e06c-4054-8f10-363283f3ac63 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.172136 Aug 29 19:13:34.978147 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 15/29] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 19:13:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:37.460522 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-71ba6b61-9cd3-4f3a-a773-287c6ebfae2a admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:37.461530 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-71ba6b61-9cd3-4f3a-a773-287c6ebfae2a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 29 19:13:37.461924 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 15/30] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:37.930674 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-4a341553-0a1a-4414-a861-33235941a080 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:38.065739 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-4a341553-0a1a-4414-a861-33235941a080 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.596202 Aug 29 19:13:38.066607 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 16/31] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:38.078532 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-2a3bb2c9-333d-4d9f-9ad1-7873603969c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:38.087356 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:38.230151 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-2a3bb2c9-333d-4d9f-9ad1-7873603969c9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154795 Aug 29 19:13:38.244339 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 16/32] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 19:13:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:40.889705 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-4a341553-0a1a-4414-a861-33235941a080 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:40.891544 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-4a341553-0a1a-4414-a861-33235941a080 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002344 Aug 29 19:13:40.892356 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 17/33] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:41.438391 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-74d14a90-acac-442a-9b58-8d4d212ef295 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "disk": 160, "name": "m1.xlarge"}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:41.617588 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-74d14a90-acac-442a-9b58-8d4d212ef295 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.716382 Aug 29 19:13:41.624552 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 17/34] 10.222.0.62 () {64 vars in 1283 bytes} [Mon Aug 29 19:13:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:13:41.632340 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-a55def55-8a63-4ed6-b5c3-d9137035bcfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:41.775415 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-a55def55-8a63-4ed6-b5c3-d9137035bcfd admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146145 Aug 29 19:13:41.776516 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 18/35] 10.222.0.62 () {64 vars in 1333 bytes} [Mon Aug 29 19:13:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:00.268497 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-74d14a90-acac-442a-9b58-8d4d212ef295 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:00.269517 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-74d14a90-acac-442a-9b58-8d4d212ef295 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 29 19:14:00.269923 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 18/36] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:14:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:00.281562 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:00.687246 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-b751a5eb-48ae-47ad-981b-c15b05ee97f8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:00.707201 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-b751a5eb-48ae-47ad-981b-c15b05ee97f8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.430233 Aug 29 19:14:00.707757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 19/37] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 19:14:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:01.812183 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-74d14a90-acac-442a-9b58-8d4d212ef295 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:01.813366 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-74d14a90-acac-442a-9b58-8d4d212ef295 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Aug 29 19:14:01.813826 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 19/38] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:02.388030 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-1a5558e5-678f-4c57-ae07-d299afbf60cb admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.394525 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.wsgi [None req-1a5558e5-678f-4c57-ae07-d299afbf60cb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-1a5558e5-678f-4c57-ae07-d299afbf60cb admin admin] Request method failure captured: Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Accept: application/json Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Accept-Encoding: gzip, deflate Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Connection: keep-alive Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Content-Length: 0 Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Host: 10.222.0.62 Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Openstack-Api-Version: compute 2.90 Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Openstack-System-Scope: None Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: User-Agent: python-novaclient Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Auth-Token: gAAAAABjDQ_5TIY1KpI_bo-ZM8wlZz7BdIrDAuVt_l1xKws-wdmxDBOI68C93xa62e6qh6tZU7jIIr-woRpNU5oocq4LbF-p19ksIICzNUGK-b83yCotzy3ho5X3RwHf7XamiAyQNyryVD5BqhBasvVOyrBKVI--4lABZqTC_EApn1tCDHhqtUQ Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Domain-Id: None Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Domain-Name: None Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Identity-Status: Confirmed Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Is-Admin-Project: True Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Domain-Id: default Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Domain-Name: Default Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Name: admin Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Role: member,admin,reader Aug 29 19:14:02.398633 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Roles: member,admin,reader Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb936e104dc24a75a45f4d04495d191b"}]}] Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant: admin Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant-Name: admin Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User: admin Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Domain-Id: default Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Domain-Name: Default Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Id: 417d5111f71945cab4c66bd4637fb5fb Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Name: admin Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: method: > Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: exception: Flavor 42 could not be found. Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: action_args: {'id': '42'} Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:02.400404 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:02.401568 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.402964 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-1a5558e5-678f-4c57-ae07-d299afbf60cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:02.404667 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-1a5558e5-678f-4c57-ae07-d299afbf60cb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.445358 Aug 29 19:14:02.404667 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 19:14:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:02.410751 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-093c101b-3cbc-4a13-ac63-4a208e0e3bc0 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.414895 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:02.435276 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-093c101b-3cbc-4a13-ac63-4a208e0e3bc0 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028749 Aug 29 19:14:02.436239 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 19:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:02.446489 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-b6ce9cf6-eadb-481c-8e5d-ffb7a20fa856 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.470905 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-b6ce9cf6-eadb-481c-8e5d-ffb7a20fa856 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027972 Aug 29 19:14:02.471456 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 19:14:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:02.482029 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ddbf3985-ead2-43e3-8bd3-02b9a236abe2 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.488396 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.wsgi [None req-ddbf3985-ead2-43e3-8bd3-02b9a236abe2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ddbf3985-ead2-43e3-8bd3-02b9a236abe2 admin admin] Request method failure captured: Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Accept: application/json Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Accept-Encoding: gzip, deflate Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Connection: keep-alive Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Content-Length: 0 Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Host: 10.222.0.62 Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Openstack-Api-Version: compute 2.90 Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Openstack-System-Scope: None Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: User-Agent: python-novaclient Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Auth-Token: gAAAAABjDQ_5TIY1KpI_bo-ZM8wlZz7BdIrDAuVt_l1xKws-wdmxDBOI68C93xa62e6qh6tZU7jIIr-woRpNU5oocq4LbF-p19ksIICzNUGK-b83yCotzy3ho5X3RwHf7XamiAyQNyryVD5BqhBasvVOyrBKVI--4lABZqTC_EApn1tCDHhqtUQ Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Domain-Id: None Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Domain-Name: None Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Identity-Status: Confirmed Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Is-Admin-Project: True Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Domain-Id: default Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Domain-Name: Default Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Name: admin Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Role: member,admin,reader Aug 29 19:14:02.491726 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Roles: member,admin,reader Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb936e104dc24a75a45f4d04495d191b"}]}] Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant: admin Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant-Name: admin Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User: admin Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Domain-Id: default Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Domain-Name: Default Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Id: 417d5111f71945cab4c66bd4637fb5fb Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Name: admin Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: method: > Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: exception: Flavor 42 could not be found. Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: action_args: {'id': '42'} Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:02.493148 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:02.493963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:02.495268 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ddbf3985-ead2-43e3-8bd3-02b9a236abe2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:02.496510 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-ddbf3985-ead2-43e3-8bd3-02b9a236abe2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015723 Aug 29 19:14:02.496510 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 21/42] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 19:14:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:03.486354 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-b6ce9cf6-eadb-481c-8e5d-ffb7a20fa856 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:03.486354 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-b6ce9cf6-eadb-481c-8e5d-ffb7a20fa856 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 29 19:14:03.486986 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 22/43] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:04.046450 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-f38ac0a5-2bdc-40dc-b480-000285d27a0b admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.053109 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.wsgi [None req-f38ac0a5-2bdc-40dc-b480-000285d27a0b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-f38ac0a5-2bdc-40dc-b480-000285d27a0b admin admin] Request method failure captured: Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Accept: application/json Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Accept-Encoding: gzip, deflate Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Connection: keep-alive Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Content-Length: 0 Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Host: 10.222.0.62 Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Openstack-Api-Version: compute 2.90 Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Openstack-System-Scope: None Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: User-Agent: python-novaclient Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Auth-Token: gAAAAABjDQ_7hTl4ebgd-V9MzzzGtEAT1Lvv9g9a-lv-eBhRBP7hUGAISg4Phg_wff0n77yFcdneyxJa8Lij92oMPvBQktAYvfUSDMc2ZI9ap0xuR1d_iQF3CNDBGTEM_JYtfbv0Sh_kGIP3t3Ni7V0GSq2NJW2Y-2RxiByXKDCI--04LLYpsWU Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Domain-Id: None Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Domain-Name: None Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Identity-Status: Confirmed Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Is-Admin-Project: True Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Domain-Id: default Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Domain-Name: Default Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Name: admin Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Role: member,admin,reader Aug 29 19:14:04.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Roles: member,admin,reader Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb936e104dc24a75a45f4d04495d191b"}]}] Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant: admin Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant-Name: admin Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User: admin Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Domain-Id: default Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Domain-Name: Default Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Id: 417d5111f71945cab4c66bd4637fb5fb Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Name: admin Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: method: > Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: exception: Flavor 84 could not be found. Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: action_args: {'id': '84'} Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:04.056241 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:04.057279 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.058627 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-f38ac0a5-2bdc-40dc-b480-000285d27a0b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:04.060141 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-f38ac0a5-2bdc-40dc-b480-000285d27a0b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.422213 Aug 29 19:14:04.060141 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 19:14:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:04.067050 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-61886eab-cbe4-4d80-9d3a-90f294f5856c admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.083188 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-61886eab-cbe4-4d80-9d3a-90f294f5856c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020442 Aug 29 19:14:04.083758 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 23/45] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 19:14:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:04.100597 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-34c21431-7efb-4460-80b1-7c08f41ad0b9 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.116125 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-34c21431-7efb-4460-80b1-7c08f41ad0b9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019522 Aug 29 19:14:04.116685 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 23/46] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 19:14:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:04.127173 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-150dc457-8113-41d5-bbcc-1d5012e7e0ef admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.132792 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.wsgi [None req-150dc457-8113-41d5-bbcc-1d5012e7e0ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-150dc457-8113-41d5-bbcc-1d5012e7e0ef admin admin] Request method failure captured: Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Accept: application/json Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Accept-Encoding: gzip, deflate Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Connection: keep-alive Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Content-Length: 0 Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Host: 10.222.0.62 Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Openstack-Api-Version: compute 2.90 Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Openstack-System-Scope: None Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: User-Agent: python-novaclient Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Auth-Token: gAAAAABjDQ_7hTl4ebgd-V9MzzzGtEAT1Lvv9g9a-lv-eBhRBP7hUGAISg4Phg_wff0n77yFcdneyxJa8Lij92oMPvBQktAYvfUSDMc2ZI9ap0xuR1d_iQF3CNDBGTEM_JYtfbv0Sh_kGIP3t3Ni7V0GSq2NJW2Y-2RxiByXKDCI--04LLYpsWU Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Domain-Id: None Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Domain-Name: None Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Identity-Status: Confirmed Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Is-Admin-Project: True Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Domain-Id: default Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Domain-Name: Default Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Name: admin Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Role: member,admin,reader Aug 29 19:14:04.134308 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Roles: member,admin,reader Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb936e104dc24a75a45f4d04495d191b"}]}] Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant: admin Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant-Name: admin Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User: admin Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Domain-Id: default Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Domain-Name: Default Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Id: 417d5111f71945cab4c66bd4637fb5fb Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Name: admin Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: method: > Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: exception: Flavor 84 could not be found. Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: action_args: {'id': '84'} Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:04.135875 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:04.136934 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:04.138405 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-150dc457-8113-41d5-bbcc-1d5012e7e0ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:04.139620 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-150dc457-8113-41d5-bbcc-1d5012e7e0ef admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012739 Aug 29 19:14:04.139620 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 24/47] 10.222.0.62 () {60 vars in 1190 bytes} [Mon Aug 29 19:14:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:05.158388 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-34c21431-7efb-4460-80b1-7c08f41ad0b9 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.159384 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-34c21431-7efb-4460-80b1-7c08f41ad0b9 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Aug 29 19:14:05.159777 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 24/48] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:05.733263 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-842b44de-2a26-4896-afb6-ae4672a7fca8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.739212 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.wsgi [None req-842b44de-2a26-4896-afb6-ae4672a7fca8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-842b44de-2a26-4896-afb6-ae4672a7fca8 admin admin] Request method failure captured: Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Accept: application/json Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Accept-Encoding: gzip, deflate Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Connection: keep-alive Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Content-Length: 0 Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Host: 10.222.0.62 Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Openstack-Api-Version: compute 2.90 Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Openstack-System-Scope: None Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: User-Agent: python-novaclient Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Auth-Token: gAAAAABjDQ_9d1a7mlEcFLb2XyLGzjV9K8IH92ycR-bEtLVIeed3wSaZmJRu29rFYpm1TV67L93LDR0VkGCBQjMz7UPSSKuCyznsHx7Wx_pG0F6Qs8_0xt-JHIeA4WrSbJbw1vRGLBNYuEotjNL4QCE7LR8IQEYf68SYF4LEJyILGUtyj0Av-yw Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Domain-Id: None Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Domain-Name: None Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Identity-Status: Confirmed Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Is-Admin-Project: True Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Domain-Id: default Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Domain-Name: Default Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Project-Name: admin Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Role: member,admin,reader Aug 29 19:14:05.740757 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Roles: member,admin,reader Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb936e104dc24a75a45f4d04495d191b"}]}] Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant: admin Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-Tenant-Name: admin Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User: admin Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Domain-Id: default Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Domain-Name: Default Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Id: 417d5111f71945cab4c66bd4637fb5fb Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: X-User-Name: admin Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: method: > Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: exception: Flavor 451 could not be found. Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: action_args: {'id': '451'} Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:05.742373 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:05.743410 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.744684 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-842b44de-2a26-4896-afb6-ae4672a7fca8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:05.745728 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-842b44de-2a26-4896-afb6-ae4672a7fca8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.444678 Aug 29 19:14:05.745728 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 25/49] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:05.752747 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-efccd534-9812-42f0-af04-c7fcfc470c44 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.769059 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-efccd534-9812-42f0-af04-c7fcfc470c44 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020418 Aug 29 19:14:05.769623 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 25/50] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:05.779444 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.795981 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019902 Aug 29 19:14:05.796559 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 26/51] 10.222.0.62 () {60 vars in 1210 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:05.807052 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-36b30a8b-1904-426a-b6de-b1c7671b966e admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.813274 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.wsgi [None req-36b30a8b-1904-426a-b6de-b1c7671b966e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-36b30a8b-1904-426a-b6de-b1c7671b966e admin admin] Request method failure captured: Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Accept: application/json Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Accept-Encoding: gzip, deflate Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Connection: keep-alive Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Content-Length: 0 Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Host: 10.222.0.62 Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Openstack-Api-Version: compute 2.90 Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Openstack-System-Scope: None Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: User-Agent: python-novaclient Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Auth-Token: gAAAAABjDQ_9d1a7mlEcFLb2XyLGzjV9K8IH92ycR-bEtLVIeed3wSaZmJRu29rFYpm1TV67L93LDR0VkGCBQjMz7UPSSKuCyznsHx7Wx_pG0F6Qs8_0xt-JHIeA4WrSbJbw1vRGLBNYuEotjNL4QCE7LR8IQEYf68SYF4LEJyILGUtyj0Av-yw Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Domain-Id: None Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Domain-Name: None Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Identity-Status: Confirmed Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Is-Admin-Project: True Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Domain-Id: default Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Domain-Name: Default Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Project-Name: admin Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Role: member,admin,reader Aug 29 19:14:05.815475 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Roles: member,admin,reader Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bb936e104dc24a75a45f4d04495d191b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bb936e104dc24a75a45f4d04495d191b"}]}] Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant: admin Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant-Id: bb936e104dc24a75a45f4d04495d191b Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-Tenant-Name: admin Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User: admin Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Domain-Id: default Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Domain-Name: Default Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Id: 417d5111f71945cab4c66bd4637fb5fb Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: X-User-Name: admin Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: method: > Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: exception: Flavor 451 could not be found. Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: action_args: {'id': '451'} Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:05.816965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:05.817804 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: ERROR nova.api.openstack.wsgi Aug 29 19:14:05.818894 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-36b30a8b-1904-426a-b6de-b1c7671b966e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:05.820118 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-36b30a8b-1904-426a-b6de-b1c7671b966e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014013 Aug 29 19:14:05.820118 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 26/52] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:06.825753 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:06.826761 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 29 19:14:06.827160 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 27/53] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:07.373549 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-b135fc1b-89eb-4c4a-8d9f-8196b5dc9b7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:07.518836 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-b135fc1b-89eb-4c4a-8d9f-8196b5dc9b7c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.551349 Aug 29 19:14:07.519307 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 27/54] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 19:14:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:14:08.527301 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:08.528369 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 29 19:14:08.528778 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:09.091426 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-2135f2a0-08b6-4796-b1fd-57787e598b06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:09.216672 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-2135f2a0-08b6-4796-b1fd-57787e598b06 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.545889 Aug 29 19:14:09.217149 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 28/56] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 19:14:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:14:10.259985 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:10.261062 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Aug 29 19:14:10.261506 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 29/57] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:10.933741 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-bcb6a8c5-77b4-40c2-bab5-456bca92bd88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:11.068238 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-bcb6a8c5-77b4-40c2-bab5-456bca92bd88 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.656534 Aug 29 19:14:11.068795 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 29/58] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 19:14:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:14:12.049333 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:12.050393 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 29 19:14:12.050813 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 30/59] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:12.583535 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-97c1eb5e-2da9-4a39-8702-8f2c8da3415a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:12.678330 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-97c1eb5e-2da9-4a39-8702-8f2c8da3415a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.488177 Aug 29 19:14:12.678888 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 30/60] 10.222.0.62 () {64 vars in 1235 bytes} [Mon Aug 29 19:14:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:14:13.647124 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:13.648210 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 29 19:14:13.648607 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 31/61] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:14:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:14.177233 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-ea8b5ef7-6491-4c75-87c8-a69d00cdaf25 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:14.198823 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-ea8b5ef7-6491-4c75-87c8-a69d00cdaf25 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.411757 Aug 29 19:14:14.199358 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 31/62] 10.222.0.62 () {60 vars in 1202 bytes} [Mon Aug 29 19:14:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:15:08.937209 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:08.938319 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-03e34bbb-72fd-4b87-b97f-5fc069d81558 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Aug 29 19:15:08.938750 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 32/63] 10.222.0.62 () {54 vars in 931 bytes} [Mon Aug 29 19:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:08.949965 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:09.397076 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-675a9106-b9bc-4727-bbd3-795597d79963 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.419336 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-675a9106-b9bc-4727-bbd3-795597d79963 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.473861 Aug 29 19:15:09.419963 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 32/64] 10.222.0.62 () {60 vars in 1292 bytes} [Mon Aug 29 19:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:15:09.440429 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG dbcounter [-] [106276] Writing DB stats nova_api:SELECT=14 {{(pid=106276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:09.444172 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-fdb099dc-dbcf-4e7f-ae39-b40a0a1ea26a admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.452161 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-fdb099dc-dbcf-4e7f-ae39-b40a0a1ea26a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013076 Aug 29 19:15:09.456175 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 33/65] 10.222.0.62 () {60 vars in 1283 bytes} [Mon Aug 29 19:15:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:09.465485 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-bf47a1dc-463a-4ed2-9d04-924744a1be52 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.474937 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-bf47a1dc-463a-4ed2-9d04-924744a1be52 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013293 Aug 29 19:15:09.475495 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 33/66] 10.222.0.62 () {60 vars in 1286 bytes} [Mon Aug 29 19:15:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:09.488114 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.496329 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011723 Aug 29 19:15:09.496894 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 34/67] 10.222.0.62 () {60 vars in 1286 bytes} [Mon Aug 29 19:15:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:09.509498 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-194e8173-1078-4216-9ea3-17347035f3a7 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.519971 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-194e8173-1078-4216-9ea3-17347035f3a7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014026 Aug 29 19:15:09.520850 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 34/68] 10.222.0.62 () {60 vars in 1283 bytes} [Mon Aug 29 19:15:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:37.066078 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:37.067284 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Aug 29 19:18:37.067678 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 35/69] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:37.210924 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=6 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:37.374263 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:37.377857 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:37.378352 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:37.378767 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:37.379460 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:37.379916 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:37.380323 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:37.414807 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-e7a09ecf-6cbc-40c8-a1de-4c6c3c97d9b2 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206005 Aug 29 19:18:37.415386 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 35/70] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 19:18:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:18:38.274449 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:38.275443 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 29 19:18:38.275837 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 36/71] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:38.475787 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:38.479489 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:38.480015 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:38.482270 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:38.487361 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:38.489701 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:38.490136 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:38.511688 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-5ac4eabc-acc1-4ea3-8086-80d41d3c9427 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.095644 Aug 29 19:18:38.512213 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 36/72] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 19:18:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:18:49.775350 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:49.776408 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Aug 29 19:18:49.776803 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:49.926126 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell0:SELECT=4 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:49.926854 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_cell1:SELECT=4 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:49.927466 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG dbcounter [-] [106277] Writing DB stats nova_api:SELECT=8 {{(pid=106277) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:49.977676 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:49.981073 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:49.981546 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:49.981994 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:49.982977 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:49.983468 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:49.983895 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:50.012498 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-0a46efb1-ccab-4638-a396-8f44102b902d admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090739 Aug 29 19:18:50.013072 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 37/74] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 19:18:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:18:50.858198 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: DEBUG nova.api.openstack.wsgi [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] Calling method '>' {{(pid=106276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:50.859189 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: INFO nova.api.openstack.requestlog [None req-55e5a9b4-f8e1-4605-bba3-92910bb0b6a8 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Aug 29 19:18:50.859578 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: [pid: 106276|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1074 bytes} [Mon Aug 29 19:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:51.056394 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG nova.api.openstack.wsgi [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Calling method '>' {{(pid=106277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:51.059812 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:51.060308 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:51.060784 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:51.061420 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:51.061886 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:51.062293 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: DEBUG oslo_concurrency.lockutils [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:51.087010 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: INFO nova.api.openstack.requestlog [None req-cded83b1-d7be-4ad6-9075-92db34ddbae9 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085706 Aug 29 19:18:51.087498 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: [pid: 106277|app: 0|req: 38/76] 10.222.0.62 () {60 vars in 1193 bytes} [Mon Aug 29 19:18:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:19:48.590931 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: Mon Aug 29 19:19:48 2022 - graceful shutdown triggered... Aug 29 19:19:48.591067 dv-cinder-855013-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 19:19:48.592025 dv-cinder-855013-1-iscsi devstack@n-api.service[106276]: Gracefully killing worker 1 (pid: 106276)... Aug 29 19:19:48.592564 dv-cinder-855013-1-iscsi devstack@n-api.service[106277]: Gracefully killing worker 2 (pid: 106277)... Aug 29 19:19:49.593146 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: worker 1 buried after 1 seconds Aug 29 19:19:49.593146 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: worker 2 buried after 1 seconds Aug 29 19:19:49.593146 dv-cinder-855013-1-iscsi devstack@n-api.service[106275]: goodbye to uWSGI. Aug 29 19:19:49.594947 dv-cinder-855013-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 19:19:49.595824 dv-cinder-855013-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 19:19:49.598772 dv-cinder-855013-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 19:19:49.608816 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 19:19:49 2022] *** Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: nodename: dv-cinder-855013-1-iscsi Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: machine: x86_64 Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: clock source: unix Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: pcre jit disabled Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: detected number of CPU cores: 4 Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: current working directory: / Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: detected binary path: /usr/bin/uwsgi-core Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: your processes number limit is 47680 Aug 29 19:19:49.611002 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: your memory page size is 4096 bytes Aug 29 19:19:49.611807 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: detected max file descriptor number: 2048 Aug 29 19:19:49.611807 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: lock engine: pthread robust mutexes Aug 29 19:19:49.611807 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: thunder lock: enabled Aug 29 19:19:49.611807 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 19:19:49.611807 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 19:19:49.654781 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: Python main interpreter initialized at 0x559fc8d019c0 Aug 29 19:19:49.654781 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: python threads support enabled Aug 29 19:19:49.654781 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: your server socket listen backlog is limited to 100 connections Aug 29 19:19:49.654781 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: your mercy for graceful operations on workers is 90 seconds Aug 29 19:19:49.655191 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 19:19:49.655274 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: *** Operational MODE: preforking *** Aug 29 19:19:49.655519 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: *** uWSGI is running in multiple interpreter mode *** Aug 29 19:19:49.655519 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: spawned uWSGI master process (pid: 121315) Aug 29 19:19:49.655772 dv-cinder-855013-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 19:19:49.656793 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: spawned uWSGI worker 1 (pid: 121336, cores: 1) Aug 29 19:19:49.656793 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: spawned uWSGI worker 2 (pid: 121337, cores: 1) Aug 29 19:19:49.657044 dv-cinder-855013-1-iscsi devstack@n-api.service[121315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 19:19:50.334017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:19:50.358609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:19:51.499210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:19:51.499210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: from cryptography.utils import int_from_bytes Aug 29 19:19:51.499836 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:19:51.499836 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: from cryptography.utils import int_from_bytes Aug 29 19:19:51.539464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:19:51.539464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: from cryptography.utils import int_from_bytes Aug 29 19:19:51.539464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:19:51.539464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: from cryptography.utils import int_from_bytes Aug 29 19:19:53.952551 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:19:53.953119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:19:53.953353 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:19:53.953629 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:19:53.953890 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:19:53.954658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.954658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.954994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.955318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.955816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-1-iscsi {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.960957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.961656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.962596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.962931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.963274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.963626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.964001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.964298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.964642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.965001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.965347 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.965671 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.966086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-1-iscsi {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.966576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.967085 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.967428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.968066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.968395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.968713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.969041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.969375 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.969691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.970029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.970358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.970687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.971023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.974787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.975733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:19:53.976172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.976248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:19:53.976325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.976325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.976463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:19:53.976542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.977118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:19:53.977223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.977297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:19:53.977447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.977528 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.977599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.977678 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.977963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.978110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.978266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.978416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.978653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.978824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.978966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.979139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.979296 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.979496 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.979661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.979803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.979986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.980146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.980297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.980474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.980625 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.980790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.980937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981085 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855013-1-iscsi {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.981977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.982135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.982275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.982414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.982572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.982741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.982937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.983350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.983501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.983649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.983791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.984768 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.984946 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.985122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.988776 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.988942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.989092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.989256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.989399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990039 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990629 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.990929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.994933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.995730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.995933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.996100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.996248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.996395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.996582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.996741 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.996741 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855013-1-iscsi {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997167 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.997930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998514 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.998944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999094 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999397 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999688 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:53.999993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.000153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.000302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.000443 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.000601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.000750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.000891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001349 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.001944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.002092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.002248 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.002403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.002555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.002555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.002833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.004732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.006475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.006650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.006800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.006954 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007104 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007246 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.007831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.008205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.008348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.008539 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.008694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.008845 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.008995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.009153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.009302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.009442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.009583 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.009723 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.009876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010598 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010754 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.010896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011177 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.011969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.012127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.012295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.012454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.014094 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.014268 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.014424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.014577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.014577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.014854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.014854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.015178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.015341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.015483 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.015631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.015795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.015795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.016107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.016107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.016401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.016565 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.016721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.016721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.016995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.017136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.017382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.017547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.017547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.017838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.018045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.018199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.018366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.018624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.018820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.018966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.019115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.019263 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.019416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.019584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.019733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.019939 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.020098 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.020247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.020389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.020550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.020700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.021789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.021953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.022123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.022416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.022579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.022579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.022850 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.023002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.023152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.023315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.024293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.024452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.024606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.024760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.024903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.025109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.025269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.025419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.025573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.025723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.025873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.026014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.026162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.026310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.026468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.026616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.026765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.026907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.027048 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.027206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.027515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.027750 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.027925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.028073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.028221 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.028370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.028520 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.028668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.028810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.028968 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.029117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.029266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.029425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.029573 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.029714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.029874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.030018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.030160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.030309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.030458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.030608 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.030748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.030889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.031045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.031195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.031354 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.031503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.031652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.031803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.031966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.032110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.032261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.032410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.032599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.032741 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.032882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.033253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.033404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.033664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.034311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.034471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.034787 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.034939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.035081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.035276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.035383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.035516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.035603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.035603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.035772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.035772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.036696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.036696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.036877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.036962 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.037053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.037151 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.037235 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.037317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.037408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.037408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.037700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:19:54.037813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.037905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.037997 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038163 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.038961 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039042 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039214 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039575 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.039956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040043 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040492 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040669 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040750 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.040930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041192 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041904 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.041904 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.042993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043157 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043246 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043424 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.043677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044504 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044587 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.044923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045015 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045996 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.045996 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046334 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046674 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046852 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.046947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047032 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.047634 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048373 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048735 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.048919 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049016 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049098 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049167 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049338 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049438 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049709 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.049964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.050920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051079 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051405 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051757 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.051840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.052689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058433 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058842 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.058999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059138 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059587 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059914 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.059990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060534 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060689 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.060980 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061509 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.061941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062097 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062167 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062236 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062543 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062625 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062857 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.062928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063228 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063544 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063848 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.063956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064113 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064412 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.064971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065122 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065425 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065562 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.065947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.066963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067398 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067550 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067619 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.067971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068198 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.068936 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069159 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069235 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069534 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069534 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.069954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070169 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070246 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.070979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.071083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.071288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.071369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.071603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.071776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.071972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072137 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072298 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072613 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072866 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.072951 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.073145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.073247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.073455 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.073549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.073773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.073873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.074192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.074300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.074507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.074616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.074818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.074931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.075133 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.075261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.075460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.075559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.075777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.075969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.076111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.076211 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.076421 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.076521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.076729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.076821 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077139 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.077974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.078073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.078284 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.078382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.078621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.078756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.078920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.079094 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.079213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.079402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.079509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.079714 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.079818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.080064 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.080161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.080391 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.080486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.080707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.080812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.081964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.082131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.082277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.082381 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.082586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.082679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.082902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.083053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.083195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.083915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.084068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.084178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.084382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.084484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.084698 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.084855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085016 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.085963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.086098 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.086274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.086417 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.086584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.086746 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.086898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.087208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.087331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.087518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.087670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.087831 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.088018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.088179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.088342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.088502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.088664 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.088809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.089014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.089144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.089358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.089466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.089691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.089795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.090008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.090125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.090318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.090539 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.090640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.090727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.091418 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.091599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.091599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.091752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.091752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.091936 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.092274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.092387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.092465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.092934 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093041 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.093692 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.094130 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.094242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.094351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.094426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.094601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.094717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.095100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.095219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.095337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.095652 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.096136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.096313 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.096497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.096636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.096756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.096952 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.097085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.097252 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.097538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.097645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.097883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.097975 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.098215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.098348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.098525 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.098712 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.098832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.099102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.099220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.099468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.099644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.099818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.099958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.100160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.100265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.100487 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.100610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.100818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.100922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.101147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.101252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.101457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.101574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.101769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.101873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.102082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.102186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.102395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.102624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.102736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.102978 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.103082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.103312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.103429 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.103628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.103739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.103975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.104076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.104293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.104402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.104607 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.104765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.104911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.105064 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.105211 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.105451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.105606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.105752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.105909 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106222 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106531 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.106976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.107131 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.107276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.107422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.107569 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.107714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.107904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.108338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.108494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.108657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.108807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.108953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.109128 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.109303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.109450 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.109604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.109759 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.109913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110072 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110675 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.110979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.111126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.111281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.111476 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.111631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.111778 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.111964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.112121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.112277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.112431 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.112656 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.112826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.112983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.113136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.113282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.113437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.113605 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.113769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.113925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.114071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.114227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.114381 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.115076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.115239 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.115387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.115540 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.115687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.115840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.116063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.116222 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.116414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.116576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.116730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.116887 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.117034 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.117188 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.117434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.117587 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.117735 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.117887 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.118044 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.118191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.118344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.118490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.118673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.118827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119469 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.119950 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.120102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.120257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.120413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.120567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.120721 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.120883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.121046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.121203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.121435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.121597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.121753 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.121910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.122101 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.122261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.122481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.122634 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.122802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.123018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.123201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.123448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.123602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.123769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.123994 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.124145 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.124291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.124447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.124602 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.124757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.124916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.125985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.126131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.126277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.126424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.126580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.126734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.126881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.127068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.127231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.127388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.127545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.127719 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.127894 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.128058 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.128273 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.128436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.128678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.128830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.128986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.129132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.129313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.129618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.129790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.129945 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.130093 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.130830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.130988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.131301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.131469 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.131619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.131775 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.131948 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.132109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.132278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.132444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.132612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.132769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.132934 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.133082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.133233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.133387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.133541 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.133689 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.133891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.134046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.134260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.134415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.134571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.134725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.134884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.135031 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.135200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.135364 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.135519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.135667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.135847 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.136057 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.136204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.136349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.136518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.136812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.136990 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.137139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.137283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.137438 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.137591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.137760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.137964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.138263 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.138422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.138576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.138743 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.138905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.139072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.139286 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.139455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.139611 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.139762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.139961 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.140123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.140277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.140437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.140600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.140807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.140970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.141135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.141298 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.141463 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.141617 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.141784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.141938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.142092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.142253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.142415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.142576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.142741 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.142903 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.143065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.143238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.143393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.143545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.143708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.143893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.144064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.144227 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.144389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.144561 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.144715 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.144875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.145037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.145191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.145354 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.145526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.145679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.145874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.146030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.146183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.146346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.146649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.146818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.146973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.147126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.147285 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.147461 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.147624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.147777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.147981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.148146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.148309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.148477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.148631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.148790 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.148952 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.149112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.149266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.149428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.149610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.149765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.149917 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.150070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.150231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.150394 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.150550 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.150703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.150855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.151015 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.151183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.151338 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.151508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.151662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.151822 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.152019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.152185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.152352 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.152511 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.152675 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.152840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.153009 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.153163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.153323 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.153487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.153640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.153793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154189 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.154986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.155141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.155294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.155454 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.155619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.155774 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.155972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156285 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156438 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.156920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.157219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.157372 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.157524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.157524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.157852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158333 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.158961 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.159122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.159283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.159444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.159621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.159781 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.160083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.160413 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.160580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.160749 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.161054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.161189 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.161903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.162023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.162231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.162343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.162543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.162717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.162866 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.163007 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.163173 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.163334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.163486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.163672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.163827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.164086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.164248 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.164406 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.164552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.164731 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.164896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.165123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.165253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.165554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.165789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.165946 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.166116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.166274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.166429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.166575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.166759 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.166914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.167077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.167221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.167384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.167528 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.167700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.167847 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.168053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.168167 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.168369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.168479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.168684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.168995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.169134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.169344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.169494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.169635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.169787 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.169926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.170202 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.170379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.170536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.170695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.170837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.170982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.171135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.171388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.171556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.171715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.171875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.171973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172080 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.172967 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.173205 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.173310 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.173509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.173614 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.173817 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.173922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.174122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.174217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.174435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.174531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.174740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.174850 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.175051 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.175146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.175360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.175455 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.175672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.175769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.176001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.176099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.176312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.176419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.176674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.176770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.177001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.177131 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.177860 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.177970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.178170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.178267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.178490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.178632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.178829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.179153 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.179300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.179467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.179586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.179780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.179926 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.180285 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.180687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.180963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.181096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.181296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.181433 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.181650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.181849 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.181975 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.182190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.182321 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.182502 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.182635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.182832 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.182955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.183156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.183281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.183468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.183600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.183780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.183935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.184199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.184330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.184547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.184678 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.184858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.184982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.185174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.185305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.185489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.185646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.185806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.185966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.186122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.186330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.186458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.186581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.186734 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187168 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.187999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.188123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.188309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.188430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.188620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.188743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.188929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.189067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.189239 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.189362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.189552 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.189676 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.189866 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.190003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.190201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.190340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.190561 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.190689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.190806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.191010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.191140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.191331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.191462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.191712 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.191881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.192022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.192138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.192341 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.192515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.192700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.192840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.193019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.193177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.193326 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.193506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.193763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.193895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.194081 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.194226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.194404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.194572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.194723 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.194889 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.195036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.195201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.195359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.195493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.195685 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.195822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.196041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.196178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.196367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.196489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.196683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.196818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197357 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197768 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.197952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.198075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.198291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.198570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.198701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.198897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.199019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.199215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.199337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.199537 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.199661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.199982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.200123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.200309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.200444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.200662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.200801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.200924 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.201052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.201216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.201347 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.201526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.201658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.201878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202434 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.202859 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203174 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.203987 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.204150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.204284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.204415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.204594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.204722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.204902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205333 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.205956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.206127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.206258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.206462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.206585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.206760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.206892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.207065 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.207275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.207397 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.207509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.207671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.207809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.208996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.209119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.209305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.209437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.209633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.209762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.209969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.210091 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.210274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.210410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.210586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.210734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.210939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.211073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.211194 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.211316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.211495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.211626 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.211807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212470 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212781 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.212905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.213107 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.213389 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.213513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.213730 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.213852 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.214046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.214181 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.214358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.214506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.214692 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.214829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215742 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.215985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.216126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.216271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.216403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.216591 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.216721 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.216903 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.217025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.217389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.217538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.217665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.217779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.217907 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.218870 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219664 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.219994 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.220154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.220300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.220448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.220710 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.220856 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221074 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.221856 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:19:54.221976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.222265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.222571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.222879 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.223186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.223493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.223805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.224690 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.225009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.225316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.225747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.226060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.226378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.226699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.227008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.227331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.227684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.228013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.228332 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.228639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.228970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.229310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.229639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.229967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.230275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.230609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.230912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.231220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.231536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.231843 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.235023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.235352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.235686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.236035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.236364 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.236686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.237006 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.237328 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.237666 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.237951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.238264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.238579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.238891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.239200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.239516 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.240501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.240822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.241131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.241442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.241957 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.242315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.242657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.242978 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.243305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.243621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.243975 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.244286 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.244615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.245584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.245954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.246273 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.246611 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.247010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.247394 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.247600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.247913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.248271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.248591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.248982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.249322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.249821 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.250000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.250306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.250634 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.250955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.251267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.251650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.252084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.252253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.252885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.253199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.253521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.253890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.254185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.254501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.254833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.255291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.255503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.255933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.256249 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.256741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.257329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.257329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.257900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.257900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.258470 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.258629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.258861 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.259173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:19:54.259430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:19:54.289393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO dbcounter [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Registered counter for database nova_api Aug 29 19:19:54.312031 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_db.sqlalchemy.engines [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.319162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writer thread running {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.322622 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO dbcounter [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Registered counter for database nova_api Aug 29 19:19:54.348535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_db.sqlalchemy.engines [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.356595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writer thread running {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.377858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.context [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2b8211c-8acf-4e46-aadb-2cdee030a23c(cell1) {{(pid=121336) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:19:54.381972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:54.382458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:54.384082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:54.384817 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:54.385265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:54.387267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:54.389311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO dbcounter [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Registered counter for database nova_cell0 Aug 29 19:19:54.393801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO dbcounter [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Registered counter for database nova_cell1 Aug 29 19:19:54.401400 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_db.sqlalchemy.engines [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.404771 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_db.sqlalchemy.engines [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.413718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writer thread running {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.414188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writer thread running {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.418481 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.context [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2b8211c-8acf-4e46-aadb-2cdee030a23c(cell1) {{(pid=121337) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:19:54.422655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:54.423133 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:54.424746 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:54.425484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:54.425928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:54.428606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:54.430598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO dbcounter [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Registered counter for database nova_cell0 Aug 29 19:19:54.434654 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO dbcounter [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Registered counter for database nova_cell1 Aug 29 19:19:54.441703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_db.sqlalchemy.engines [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.443011 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_db.sqlalchemy.engines [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.450031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writer thread running {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.451354 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writer thread running {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.564450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO dbcounter [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Registered counter for database nova_cell0 Aug 29 19:19:54.571728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_db.sqlalchemy.engines [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.576197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writer thread running {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.600205 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO dbcounter [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Registered counter for database nova_cell0 Aug 29 19:19:54.607112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_db.sqlalchemy.engines [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:19:54.612535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writer thread running {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:19:54.903188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: WARNING keystonemiddleware.auth_token [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:19:54.910419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: WARNING keystonemiddleware.auth_token [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:19:54.944428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: WARNING keystonemiddleware.auth_token [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:19:54.952335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: WARNING keystonemiddleware.auth_token [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:19:55.259289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: WARNING keystonemiddleware.auth_token [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:19:55.265415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: WARNING keystonemiddleware.auth_token [None req-0806ae38-e836-4b74-9ee8-b123de0a0feb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:19:55.270794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fc8d019c0 pid: 121336 (default app) Aug 29 19:19:55.308893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: WARNING keystonemiddleware.auth_token [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:19:55.315195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: WARNING keystonemiddleware.auth_token [None req-4c6cc848-1bc5-411e-9555-f0e7788f5463 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:19:55.320683 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559fc8d019c0 pid: 121337 (default app) Aug 29 19:20:33.492572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.494680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.495824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.497154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.872196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.873152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.874233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.875560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:34.650483 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-02013710-f9e2-45b9-97c1-8ad4a361c7fd tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Action: 'create', calling method: .version_select at 0x7f1fdf500ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1552564732", "metadata": {"Type": "work"}}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-02013710-f9e2-45b9-97c1-8ad4a361c7fd tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Request method failure captured: Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 122 Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGBW-_kGxqT8zB7_R0_Ma8F4BhRF29mDNQsiDdLXNGnsMtXqX0wp_A_jc64okTb3VuRi0bjPS2uA_HDjVIq29FDXITQYOv5mp0auoHyg0j8NwQcZwsbdQrfzG9H977lcSU7zNdvPOgQZvaMd7K3_Zq7NOWzEh9atn-cnNq_LEbpqFo Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:34.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/76a7037e22b543268635379f8491c774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_76a7037e22b543268635379f8491c774"}]}] Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c2b79cbc9fb4751a51986d9cf8ff5ad Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1552564732", "metadata": {"Type": "work"}}} Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:34.658823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1552564732', 'metadata': {'Type': 'work'}}}} Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:34.659770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:20:34.662050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:20:34.664697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:20:34.664697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.664697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-02013710-f9e2-45b9-97c1-8ad4a361c7fd tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:34.664697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-02013710-f9e2-45b9-97c1-8ad4a361c7fd tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.187030 Aug 29 19:20:34.665812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 19:20:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:20:34.670967 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ddf0df54-a9c5-4022-964a-0ff51b110dce tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Action: 'create', calling method: .version_select at 0x7f1fdf4d09d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2124901065", "metadata": {"Type": "work"}}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ddf0df54-a9c5-4022-964a-0ff51b110dce tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Request method failure captured: Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 120 Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGBW-_kGxqT8zB7_R0_Ma8F4BhRF29mDNQsiDdLXNGnsMtXqX0wp_A_jc64okTb3VuRi0bjPS2uA_HDjVIq29FDXITQYOv5mp0auoHyg0j8NwQcZwsbdQrfzG9H977lcSU7zNdvPOgQZvaMd7K3_Zq7NOWzEh9atn-cnNq_LEbpqFo Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:34.674501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/76a7037e22b543268635379f8491c774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_76a7037e22b543268635379f8491c774"}]}] Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c2b79cbc9fb4751a51986d9cf8ff5ad Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2124901065", "metadata": {"Type": "work"}}} Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:34.675809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2124901065', 'metadata': {'Type': 'work'}}}} Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi '0' Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:34.677088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:20:34.679391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:20:34.681962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:20:34.681962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.681962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ddf0df54-a9c5-4022-964a-0ff51b110dce tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:34.681962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ddf0df54-a9c5-4022-964a-0ff51b110dce tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008657 Aug 29 19:20:34.681962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 2/2] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 19:20:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-da8604b1-cdd1-4b17-83e3-dde587edb520 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Action: 'create', calling method: .version_select at 0x7f1fdf3cda60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2016731092", "metadata": {"Type": "work"}}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-da8604b1-cdd1-4b17-83e3-dde587edb520 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Request method failure captured: Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 119 Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGBW-_kGxqT8zB7_R0_Ma8F4BhRF29mDNQsiDdLXNGnsMtXqX0wp_A_jc64okTb3VuRi0bjPS2uA_HDjVIq29FDXITQYOv5mp0auoHyg0j8NwQcZwsbdQrfzG9H977lcSU7zNdvPOgQZvaMd7K3_Zq7NOWzEh9atn-cnNq_LEbpqFo Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:34.691147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/76a7037e22b543268635379f8491c774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_76a7037e22b543268635379f8491c774"}]}] Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c2b79cbc9fb4751a51986d9cf8ff5ad Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2016731092", "metadata": {"Type": "work"}}} Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:34.693356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2016731092', 'metadata': {'Type': 'work'}}}} Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi '' Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:34.694365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:20:34.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:20:34.697156 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:20:34.697156 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:34.697156 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-da8604b1-cdd1-4b17-83e3-dde587edb520 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:34.697693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-da8604b1-cdd1-4b17-83e3-dde587edb520 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013244 Aug 29 19:20:35.029598 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 3/3] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 19:20:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:20:35.029598 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-696c6ee4-8096-49b4-a1e0-85ad718196ab tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Calling method '.version_select at 0x7f1fdf3cd790>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:35.030611 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-373e0283-6350-4389-aff1-0b9415e7c1e1 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Action: 'create', calling method: .version_select at 0x7f1fdf527940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-444276242", "metadata": {"Type": "work"}}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:35.468861 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-696c6ee4-8096-49b4-a1e0-85ad718196ab tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] HTTP exception thrown: Volume tempest-invalid-1847933775 could not be found. Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-696c6ee4-8096-49b4-a1e0-85ad718196ab tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Request method failure captured: Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1847933775 HTTP/1.1 Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGBW-_kGxqT8zB7_R0_Ma8F4BhRF29mDNQsiDdLXNGnsMtXqX0wp_A_jc64okTb3VuRi0bjPS2uA_HDjVIq29FDXITQYOv5mp0auoHyg0j8NwQcZwsbdQrfzG9H977lcSU7zNdvPOgQZvaMd7K3_Zq7NOWzEh9atn-cnNq_LEbpqFo Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:35.475198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/76a7037e22b543268635379f8491c774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_76a7037e22b543268635379f8491c774"}]}] Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c2b79cbc9fb4751a51986d9cf8ff5ad Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Volume tempest-invalid-1847933775 could not be found. Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'tempest-invalid-1847933775'} Aug 29 19:20:35.476503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1847933775 could not be found. (HTTP 404) (Request-ID: req-c7eaa53a-3f58-4d6e-a88f-8c41ec2a02fe) Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:35.477319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:20:35.478580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1847933775 could not be found. Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:20:35.479646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1847933775 could not be found. Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1847933775 could not be found. Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-696c6ee4-8096-49b4-a1e0-85ad718196ab tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Returning 404 to user: Volume tempest-invalid-1847933775 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:35.481605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-696c6ee4-8096-49b4-a1e0-85ad718196ab tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1847933775" status: 404 len: 99 microversion: 2.1 time: 0.771451 Aug 29 19:20:35.483062 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 4/4] 10.222.0.62 () {58 vars in 1218 bytes} [Mon Aug 29 19:20:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1847933775 => generated 99 bytes in 777 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:20:35.489660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-80b16b7d-e2b8-4910-a2e5-5512d0e54f6d tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004076 Aug 29 19:20:35.490270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 5/5] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 19:20:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 19:20:35.507657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b4e0331e-6865-4989-bbfa-96651267be91 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007807 Aug 29 19:20:35.508553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1137 bytes} [Mon Aug 29 19:20:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 19:20:35.518135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a3859e53-6a73-44c9-b2eb-92b098f5d729 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Calling method '.version_select at 0x7f1fdf30ed30>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:35.987261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-a3859e53-6a73-44c9-b2eb-92b098f5d729 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] HTTP exception thrown: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a3859e53-6a73-44c9-b2eb-92b098f5d729 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Request method failure captured: Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/os-volumes/46a26607-7b78-422f-bc26-fd3f0e42a70b HTTP/1.1 Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGBW-_kGxqT8zB7_R0_Ma8F4BhRF29mDNQsiDdLXNGnsMtXqX0wp_A_jc64okTb3VuRi0bjPS2uA_HDjVIq29FDXITQYOv5mp0auoHyg0j8NwQcZwsbdQrfzG9H977lcSU7zNdvPOgQZvaMd7K3_Zq7NOWzEh9atn-cnNq_LEbpqFo Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:35.988190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/76a7037e22b543268635379f8491c774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_76a7037e22b543268635379f8491c774"}]}] Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c2b79cbc9fb4751a51986d9cf8ff5ad Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '46a26607-7b78-422f-bc26-fd3f0e42a70b'} Aug 29 19:20:35.997087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. (HTTP 404) (Request-ID: req-acd58955-6e17-4b11-a531-93e3611af2c0) Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:35.998485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:20:36.000573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:20:36.002482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a3859e53-6a73-44c9-b2eb-92b098f5d729 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Returning 404 to user: Volume 46a26607-7b78-422f-bc26-fd3f0e42a70b could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a3859e53-6a73-44c9-b2eb-92b098f5d729 tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/46a26607-7b78-422f-bc26-fd3f0e42a70b" status: 404 len: 109 microversion: 2.1 time: 0.474858 Aug 29 19:20:36.007957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 7/7] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:20:35 2022] DELETE /compute/v2.1/os-volumes/46a26607-7b78-422f-bc26-fd3f0e42a70b => generated 109 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:20:36.011937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6ca4a88f-a280-486b-818d-e66730f770bb tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Calling method '.version_select at 0x7f1fdf30e700>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-6ca4a88f-a280-486b-818d-e66730f770bb tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] HTTP exception thrown: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6ca4a88f-a280-486b-818d-e66730f770bb tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Request method failure captured: Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/os-volumes/2f3596ab-1f6e-463e-a979-4b86268bc929 HTTP/1.1 Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGBW-_kGxqT8zB7_R0_Ma8F4BhRF29mDNQsiDdLXNGnsMtXqX0wp_A_jc64okTb3VuRi0bjPS2uA_HDjVIq29FDXITQYOv5mp0auoHyg0j8NwQcZwsbdQrfzG9H977lcSU7zNdvPOgQZvaMd7K3_Zq7NOWzEh9atn-cnNq_LEbpqFo Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:36.866231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/76a7037e22b543268635379f8491c774"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/76a7037e22b543268635379f8491c774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_76a7037e22b543268635379f8491c774"}]}] Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 76a7037e22b543268635379f8491c774 Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesNegativeTest-568293488 Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c2b79cbc9fb4751a51986d9cf8ff5ad Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesNegativeTest-568293488-project Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '2f3596ab-1f6e-463e-a979-4b86268bc929'} Aug 29 19:20:36.867523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. (HTTP 404) (Request-ID: req-cb08a73e-1a0b-4985-bda8-d1ab2c59fbb8) Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:36.869011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:20:36.870138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:20:36.871257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6ca4a88f-a280-486b-818d-e66730f770bb tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] Returning 404 to user: Volume 2f3596ab-1f6e-463e-a979-4b86268bc929 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6ca4a88f-a280-486b-818d-e66730f770bb tempest-VolumesNegativeTest-568293488 tempest-VolumesNegativeTest-568293488-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2f3596ab-1f6e-463e-a979-4b86268bc929" status: 404 len: 109 microversion: 2.1 time: 0.857694 Aug 29 19:20:36.872645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 8/8] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:35 2022] GET /compute/v2.1/os-volumes/2f3596ab-1f6e-463e-a979-4b86268bc929 => generated 109 bytes in 860 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:20:36.974542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-373e0283-6350-4389-aff1-0b9415e7c1e1 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.114794 Aug 29 19:20:36.976134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 1/9] 10.222.0.62 () {60 vars in 1156 bytes} [Mon Aug 29 19:20:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3120 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 19:20:37.011392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fd765182-a9aa-4356-a0c3-4d8047e015cc tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf30ec10>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:37.128490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fd765182-a9aa-4356-a0c3-4d8047e015cc tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 200 len: 352 microversion: 2.1 time: 0.122700 Aug 29 19:20:37.129217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 9/10] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:37 2022] GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:37.294412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6cef447f-2a0d-4356-ad63-1d23cff1badc tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf390ca0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:37.369731 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6cef447f-2a0d-4356-ad63-1d23cff1badc tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fef1852a-bd72-4667-a198-e5b4f77ae106" status: 200 len: 351 microversion: 2.1 time: 0.081198 Aug 29 19:20:37.370931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 2/11] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:37 2022] GET /compute/v2.1/os-volumes/fef1852a-bd72-4667-a198-e5b4f77ae106 => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:38.150122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b0ef824d-8126-4fec-8e79-656978948f0f tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf30e3a0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:38.236900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b0ef824d-8126-4fec-8e79-656978948f0f tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 200 len: 353 microversion: 2.1 time: 0.095536 Aug 29 19:20:38.238191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 10/12] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:38 2022] GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:38.255309 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0a78b1ab-2957-4ea3-bc46-6bb454270509 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf566ee0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:38.357755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0a78b1ab-2957-4ea3-bc46-6bb454270509 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 200 len: 353 microversion: 2.1 time: 0.110054 Aug 29 19:20:38.358315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 3/13] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:38 2022] GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:38.387161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1a44aff6-9b4e-4bac-85b8-4e4f210c9081 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf2a9550>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:39.023092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1a44aff6-9b4e-4bac-85b8-4e4f210c9081 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 202 len: 0 microversion: 2.1 time: 0.646188 Aug 29 19:20:39.023557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 11/14] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:20:38 2022] DELETE /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:20:39.032243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e872a753-c7a2-4f3e-ab56-ef88c1a401de tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf39d550>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:39.141136 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e872a753-c7a2-4f3e-ab56-ef88c1a401de tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 200 len: 352 microversion: 2.1 time: 0.112084 Aug 29 19:20:39.142083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 4/15] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:39 2022] GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:39.268440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1d803192-db28-4978-8e0a-d405483056d4 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf2a9a60>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:39.372976 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1d803192-db28-4978-8e0a-d405483056d4 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/60e62e1f-b4cc-411b-9edf-a7bceccdb8cf" status: 200 len: 351 microversion: 2.1 time: 0.107910 Aug 29 19:20:39.373976 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 12/16] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:39 2022] GET /compute/v2.1/os-volumes/60e62e1f-b4cc-411b-9edf-a7bceccdb8cf => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:40.158890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-181eca9c-b16f-49f5-a501-f49bdafb89a7 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf39dc10>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:40.253343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-181eca9c-b16f-49f5-a501-f49bdafb89a7 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 200 len: 352 microversion: 2.1 time: 0.100980 Aug 29 19:20:40.254989 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 5/17] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:40 2022] GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:41.268113 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-182b946c-35e7-4143-8ad8-6da0b22103b5 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Calling method '.version_select at 0x7f1fdf30e820>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:41.331518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-182b946c-35e7-4143-8ad8-6da0b22103b5 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] HTTP exception thrown: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-182b946c-35e7-4143-8ad8-6da0b22103b5 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Request method failure captured: Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 HTTP/1.1 Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGB3lKTcnMTZ1oeG1jZpcTGRClJaWZT-BeMd2aImnLU4_syJnrc0it8m0rWYAIPJAFCvjU_rmLA87_QQZoieYD8k0rQwOZDzO4Nmrsq5bgUbT8yglZXKQ-nRn7mmpKmLZI40R9p_245zbcUZsrxlpbQESRZzDwCoKNDDqrKqQRje1g Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 837fdaee5fde423587a1418f8f322ff2 Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesGetTestJSON-1583525847 Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:20:41.334346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/837fdaee5fde423587a1418f8f322ff2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/837fdaee5fde423587a1418f8f322ff2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/837fdaee5fde423587a1418f8f322ff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_837fdaee5fde423587a1418f8f322ff2"}]}] Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesGetTestJSON-1583525847 Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 837fdaee5fde423587a1418f8f322ff2 Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesGetTestJSON-1583525847 Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesGetTestJSON-1583525847-project Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: a7b0a420e50e49fe87365540ce9bf30d Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesGetTestJSON-1583525847-project Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '50e1560a-00ed-4454-a43b-230dfa86d970'} Aug 29 19:20:41.336172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. (HTTP 404) (Request-ID: req-4b3d7a3b-f7f3-400b-a606-97501350b67d) Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:41.337037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:20:41.338212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:20:41.339317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. Aug 29 19:20:41.340467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:20:41.342736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-182b946c-35e7-4143-8ad8-6da0b22103b5 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] Returning 404 to user: Volume 50e1560a-00ed-4454-a43b-230dfa86d970 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:20:41.343795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-182b946c-35e7-4143-8ad8-6da0b22103b5 tempest-VolumesGetTestJSON-1583525847 tempest-VolumesGetTestJSON-1583525847-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970" status: 404 len: 109 microversion: 2.1 time: 0.079800 Aug 29 19:20:41.344876 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 13/18] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:41 2022] GET /compute/v2.1/os-volumes/50e1560a-00ed-4454-a43b-230dfa86d970 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:20:43.501119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7034462f-0fa0-49db-b292-9b6f9e692b53 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf39db80>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:43.600785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7034462f-0fa0-49db-b292-9b6f9e692b53 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/e3cd336a-9b15-484c-932e-90ce11fc7ec5" status: 200 len: 350 microversion: 2.1 time: 0.103697 Aug 29 19:20:43.610708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 6/19] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:20:43 2022] GET /compute/v2.1/os-volumes/e3cd336a-9b15-484c-932e-90ce11fc7ec5 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:43.616076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-53eb97a4-6cff-4736-b0e3-8f87aae3da10 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf2a9ca0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:43.756229 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-53eb97a4-6cff-4736-b0e3-8f87aae3da10 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.144958 Aug 29 19:20:43.757412 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 14/20] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Aug 29 19:20:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:43.774320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2e4e62a6-89be-4d3b-a795-a454655bfead tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf39d4c0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:43.973014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2e4e62a6-89be-4d3b-a795-a454655bfead tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.202512 Aug 29 19:20:43.973965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 7/21] 10.222.0.62 () {58 vars in 1149 bytes} [Mon Aug 29 19:20:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:43.994087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e5235ab4-61e9-43c1-a35d-cff48ba6918e tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf30eee0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:44.176132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e5235ab4-61e9-43c1-a35d-cff48ba6918e tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.192352 Aug 29 19:20:44.177277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 15/22] 10.222.0.62 () {58 vars in 1134 bytes} [Mon Aug 29 19:20:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:44.189495 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b1889dc2-b569-4362-823a-54038bda4807 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf3a14c0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:44.355228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b1889dc2-b569-4362-823a-54038bda4807 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.167741 Aug 29 19:20:44.355228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 8/23] 10.222.0.62 () {58 vars in 1167 bytes} [Mon Aug 29 19:20:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:44.375369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cbd919a7-ed9d-4a9c-8b41-bacc8aaea42a tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf2a91f0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:44.517792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cbd919a7-ed9d-4a9c-8b41-bacc8aaea42a tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.146251 Aug 29 19:20:44.534437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 16/24] 10.222.0.62 () {58 vars in 1170 bytes} [Mon Aug 29 19:20:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:44.536413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ed5e3e08-e900-458b-9c68-fe71334f447b tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf3a1e50>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:44.716144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ed5e3e08-e900-458b-9c68-fe71334f447b tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184376 Aug 29 19:20:44.717177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 9/25] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 19:20:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:20:44.731027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7706b8cf-2d2b-4926-af3c-992b640dd15d tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf371790>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:45.005323 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7706b8cf-2d2b-4926-af3c-992b640dd15d tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.278482 Aug 29 19:20:45.007269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 17/26] 10.222.0.62 () {58 vars in 1188 bytes} [Mon Aug 29 19:20:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:20:45.023086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fc7ac65b-fa48-40f3-97d8-9f3d1b6922f4 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] Calling method '.version_select at 0x7f1fdf566ee0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:45.220490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fc7ac65b-fa48-40f3-97d8-9f3d1b6922f4 tempest-VolumesTestJSON-1905145084 tempest-VolumesTestJSON-1905145084-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202328 Aug 29 19:20:45.221585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 10/27] 10.222.0.62 () {58 vars in 1155 bytes} [Mon Aug 29 19:20:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:46.385748 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1611757690", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "networks": [{"uuid": "8f7020b4-4ef6-467f-b601-ef8ec6c3b053"}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:46.570892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] validate_networks() for [('8f7020b4-4ef6-467f-b601-ef8ec6c3b053', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:20:48.242507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:20:48.244770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:20:48.244770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:20:48.244770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:20:48.244770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:20:48.276849 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:48.277241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:48.277689 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:48.278453 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:48.278912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:48.279338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:48.340425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Getting quotas for project f991d9be87e5494588cafcdcd6841e7d. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:20:48.358479 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Getting quotas for user f97d0910139b4610b792092b6133596d and project f991d9be87e5494588cafcdcd6841e7d. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:20:48.399687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:20:48.403619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:20:48.677729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-38b07b21-4d30-4436-8a59-6a7fc88c340d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.880063 Aug 29 19:20:48.679487 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 18/28] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:20:48.693019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0db57f9b-2eb5-41ae-b3b3-84ccb8017ba5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:48.693643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0db57f9b-2eb5-41ae-b3b3-84ccb8017ba5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:49.081094 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0db57f9b-2eb5-41ae-b3b3-84ccb8017ba5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:49.118703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0db57f9b-2eb5-41ae-b3b3-84ccb8017ba5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1215 microversion: 2.1 time: 0.430928 Aug 29 19:20:49.119290 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 11/29] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:48 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:50.141560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-07eb6734-b9c2-4c7d-ad3b-6e08941e30f4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:50.142297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-07eb6734-b9c2-4c7d-ad3b-6e08941e30f4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:50.304325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-07eb6734-b9c2-4c7d-ad3b-6e08941e30f4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:50.323799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-07eb6734-b9c2-4c7d-ad3b-6e08941e30f4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1215 microversion: 2.1 time: 0.188014 Aug 29 19:20:50.324876 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 19/30] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:50 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:51.345631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-af17a806-6d8b-4920-93be-63c8a428a5e4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'create', calling method: .version_select at 0x7f1fdf3a11f0>, body: {"keypair": {"name": "tempest-keypair-1682815149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhJPcAeyuNTWWgeyvvlmtQrbPagMI9qD7WXqicJeZf18w+MO6zsmGt2uKaXx/gWCyF2W4Ic2mpzKNLmdvNcVfKCc3zwvCtPA3xPLLtOUCQw+VLd7AJXtbTTfnCbDlcH3w=="}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:51.376595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-610963163", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:51.507318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] validate_networks() for [('dcf7c3c4-f23e-4e33-a023-3ee1e56d4ff9', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:20:51.541904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-af17a806-6d8b-4920-93be-63c8a428a5e4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for project de427c8638c049d3ad809158b0ccc0d2. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:20:51.549001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-af17a806-6d8b-4920-93be-63c8a428a5e4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for user 74bfde91bf944824bdae8207641a08b7 and project de427c8638c049d3ad809158b0ccc0d2. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:20:51.782442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-af17a806-6d8b-4920-93be-63c8a428a5e4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.628534 Aug 29 19:20:51.782442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 12/31] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 19:20:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 631 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 19:20:51.793863 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e397f9d6-a6e9-49f2-b73b-fc872ec75777 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:51.794499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e397f9d6-a6e9-49f2-b73b-fc872ec75777 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:52.004702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e397f9d6-a6e9-49f2-b73b-fc872ec75777 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:52.016209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e397f9d6-a6e9-49f2-b73b-fc872ec75777 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1215 microversion: 2.1 time: 0.236055 Aug 29 19:20:52.032138 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 13/32] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:51 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1215 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:52.521389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:20:52.522160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:20:52.522648 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:20:52.523059 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:20:52.523481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:20:52.541531 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:52.542452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:52.543067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:52.544036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:52.544670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:52.545261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:52.596072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for project fec9a23227784d23ba703719c785e413. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:20:52.610708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for user bd993c0493d447cb9b02e424a28e24bc and project fec9a23227784d23ba703719c785e413. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:20:52.649456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:20:52.672085 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:20:52.981491 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4be7a897-11e9-4aed-9cf6-5076b8957b74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.757796 Aug 29 19:20:52.987475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 20/33] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:20:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:20:52.997966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-60c4ced9-dcd8-4d04-b65a-71c4025d4b7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:52.999315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-60c4ced9-dcd8-4d04-b65a-71c4025d4b7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:53.038885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:53.040155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:53.052195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:53.054416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:53.055786 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:53.058443 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:53.062092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:53.064699 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:53.158978 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-60c4ced9-dcd8-4d04-b65a-71c4025d4b7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:53.170803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-60c4ced9-dcd8-4d04-b65a-71c4025d4b7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1221 microversion: 2.1 time: 0.174511 Aug 29 19:20:53.208204 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 14/34] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:52 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:53.468922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-643658727", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:53.546075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:53.584005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-64addecb-2b44-4d0e-a627-311a04d0b92a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1211 microversion: 2.1 time: 0.545629 Aug 29 19:20:53.590812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 21/35] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:53 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1211 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:20:53.650161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] validate_networks() for [('dcf7c3c4-f23e-4e33-a023-3ee1e56d4ff9', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:20:54.612739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:54.613350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:54.631362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:54.631988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:54.632898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:54.634097 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:54.634775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:54.635878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:54.804693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:54.815070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-112ae6f5-9f58-4138-8fbe-8e0cfcb43ed1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1267 microversion: 2.1 time: 0.208169 Aug 29 19:20:54.816073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 22/36] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:54 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:55.556400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:20:55.556914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:20:55.557349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:20:55.557761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:20:55.558181 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:20:55.583895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:55.587213 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:55.588166 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:55.589190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:55.589806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:55.592142 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:55.640118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for project fec9a23227784d23ba703719c785e413. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:20:55.660728 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for user bd993c0493d447cb9b02e424a28e24bc and project fec9a23227784d23ba703719c785e413. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:20:55.678547 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:20:55.682017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:20:55.841555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:55.842287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:55.849582 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:55.858660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:55.858660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:55.858660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:55.858660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:55.859540 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:55.873782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c9dca802-9a8a-4fd0-867f-83abe23bad90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.410847 Aug 29 19:20:55.875121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 15/37] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:20:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:20:55.887809 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2bd87042-8706-4854-a93f-42d836033bc7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:55.888995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2bd87042-8706-4854-a93f-42d836033bc7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:55.954916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:55.965331 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-397b08a7-99ed-497b-a1ff-74444361b2e7 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1275 microversion: 2.1 time: 0.128225 Aug 29 19:20:55.967006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 23/38] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:55 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:20:55.980217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2bd87042-8706-4854-a93f-42d836033bc7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:55.994829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2bd87042-8706-4854-a93f-42d836033bc7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1221 microversion: 2.1 time: 0.110757 Aug 29 19:20:55.995777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 16/39] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:55 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:57.007507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:57.008690 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:57.026194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e8d41fc8-f790-484a-85e2-67c96dfcacea tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:57.030110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e8d41fc8-f790-484a-85e2-67c96dfcacea tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:57.056874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:57.062855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:57.065767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:57.067281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:57.069326 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:57.071536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:57.495184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e8d41fc8-f790-484a-85e2-67c96dfcacea tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:57.518377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e8d41fc8-f790-484a-85e2-67c96dfcacea tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1221 microversion: 2.1 time: 0.504754 Aug 29 19:20:57.522974 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 17/40] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:57 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1221 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:57.531491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-54700016", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77442b81-83b9-4ea8-a1cc-4b658ab1760b"}], "security_groups": [{"name": "tempest-securitygroup--1794710562"}], "key_name": "tempest-keypair-1682815149", "user_data": "}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:20:57.540758 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:57.563441 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-26665faa-8efa-483e-9435-657a608eefcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1275 microversion: 2.1 time: 0.577116 Aug 29 19:20:57.581177 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 24/41] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:56 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1275 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:57.694374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] validate_networks() for [('77442b81-83b9-4ea8-a1cc-4b658ab1760b', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:20:58.395233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:20:58.397224 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:20:58.398002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:20:58.398582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:20:58.399620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:20:58.415963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:58.416462 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:58.416894 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:58.419655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:58.424250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:58.424703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:58.452020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for project de427c8638c049d3ad809158b0ccc0d2. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:20:58.463701 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for user 74bfde91bf944824bdae8207641a08b7 and project de427c8638c049d3ad809158b0ccc0d2. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:20:58.478921 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:20:58.486248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:20:58.542493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:58.543120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:58.554542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:58.555117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:58.555526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:58.556232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:58.564191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:58.564191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:58.703095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ddcc3f35-cba9-4b99-82b2-2bdcf2d1c8f7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.178426 Aug 29 19:20:58.708424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 18/42] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 19:20:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 19:20:58.715375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:58.723282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:58.737983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:58.738491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:58.739646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:58.741277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:58.756638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:58.759663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:58.760483 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:58.770899 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2a1537a6-bd5b-4d97-b54e-72602618b71a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1273 microversion: 2.1 time: 0.233336 Aug 29 19:20:58.788589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 25/43] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:58 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:58.812000 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-86500122-4cee-4b9f-ab15-4604a6a3b189 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:58.812625 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-86500122-4cee-4b9f-ab15-4604a6a3b189 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:58.989428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-86500122-4cee-4b9f-ab15-4604a6a3b189 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:59.014306 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-86500122-4cee-4b9f-ab15-4604a6a3b189 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:59.020107 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-86500122-4cee-4b9f-ab15-4604a6a3b189 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:59.021266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-86500122-4cee-4b9f-ab15-4604a6a3b189 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1280 microversion: 2.20 time: 0.231631 Aug 29 19:20:59.021821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 26/44] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:20:58 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:20:59.046248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:20:59.056892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bfe695f7-9bae-4f56-a81e-a36753a4ccef tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1273 microversion: 2.1 time: 0.347224 Aug 29 19:20:59.057607 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 19/45] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:58 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:20:59.805027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:20:59.808176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:20:59.828658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:59.837879 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:59.839595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:20:59.842996 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:20:59.846396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:20:59.847984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:00.049593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2a3667dd-274c-4159-9e02-58ffa5b96a6b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:00.050353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2a3667dd-274c-4159-9e02-58ffa5b96a6b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:00.195522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:00.211681 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fdb1a1ba-a0e3-4662-b843-127304d08fca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1281 microversion: 2.1 time: 0.413705 Aug 29 19:21:00.214042 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 27/46] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:20:59 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1281 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:00.227209 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:00.228262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:00.250771 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:00.251518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:00.253783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:00.256181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:00.259116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:00.263030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:00.427560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2a3667dd-274c-4159-9e02-58ffa5b96a6b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:00.481381 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2a3667dd-274c-4159-9e02-58ffa5b96a6b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:00.485738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2a3667dd-274c-4159-9e02-58ffa5b96a6b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:00.495758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2a3667dd-274c-4159-9e02-58ffa5b96a6b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1280 microversion: 2.20 time: 0.449186 Aug 29 19:21:00.502274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 20/47] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:00 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1280 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:01.151439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:01.160241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8fb23b6a-60d1-41ce-aebe-d5c954bb16be tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.944816 Aug 29 19:21:01.170337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 28/48] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:00 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:01.240998 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:01.245641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:01.261237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:01.263062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:01.264088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:01.265022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:01.268541 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:01.272070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:01.569275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:01.569275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3ffe46c3-7fdb-4537-b17c-134ff4d4a14b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1279 microversion: 2.1 time: 0.152958 Aug 29 19:21:01.569275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 21/49] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:01 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:01.569885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:01.569885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:01.569885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:01.569885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:01.570616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:01.570616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:01.570616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:01.570616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:01.611740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:01.620211 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:01.621658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:01.622770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-057931a7-bd4d-4dcc-8eb7-0ca8121f1f99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.104133 Aug 29 19:21:01.636056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 29/50] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:01 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:02.190531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:02.191942 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:02.198986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:02.199485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:02.199951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:02.200647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:02.212609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:02.213068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:02.578890 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:02.580139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:02.598476 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:02.602383 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:02.604360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:02.604958 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:02.607979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:02.612656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:02.614264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:02.717503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:02.729802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-042f2fdc-63a4-4a4e-a984-b8bb7ea168a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1279 microversion: 2.1 time: 0.161665 Aug 29 19:21:02.736367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 30/51] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:02 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:02.743303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:02.744155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:02.750857 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:02.756649 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:02.756649 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:02.756649 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:02.756649 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:02.756965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:02.807304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:02.807304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2c55aae5-8c32-4af0-bc76-5defe8bb3bee tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.617871 Aug 29 19:21:02.807304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 22/52] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:02 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:02.847254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:02.857668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:02.859799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:02.861246 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8ab6b799-13b3-4d30-a9db-f556c2144f1a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.123107 Aug 29 19:21:02.861901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 31/53] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:02 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:03.341638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03815042-41b5-4e56-a2cc-fa3223abbb2b", "tag": "cfd33ea2-8339-4abc-9b9c-942cf02465d8"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:03.371349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.371878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.372305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:03.395771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Creating event network-changed:cfd33ea2-8339-4abc-9b9c-942cf02465d8 for instance 03815042-41b5-4e56-a2cc-fa3223abbb2b on hv-cinder-85501 Aug 29 19:21:03.396331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 19:21:03.396723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e23421c2-5a67-4475-9438-272db66a8c61 req-78b140a1-2cdd-443f-8f8e-98d2f9719934 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 19:21:03.397807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.398299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.398623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:03.399322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.399785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.403274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:03.408914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.compute.rpcapi [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 19:21:03.409827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] Releasing lock "compute-rpcapi-router" {{(pid=121337) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 19:21:03.425269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c643ea9a-7bfe-4491-9d51-c0277b5e7939 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171968 Aug 29 19:21:03.425873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 23/54] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:03.753613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:03.754631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:03.767806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.768402 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.768827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:03.770272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.770718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.771283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:03.830987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:03.832312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:03.846292 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.851135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.851790 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:03.852620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:03.853214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:03.853805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:04.026891 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:04.044915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e2074c0d-3f9d-4205-9151-afd32775d6a8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.295083 Aug 29 19:21:04.059296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 32/55] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:03 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:04.064388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:04.078999 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:04.078999 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:04.080060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:04.080060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:04.080572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:04.081300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:04.082406 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:04.090250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:04.103288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4765b34d-9c36-4d08-9d2d-97809117395a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.278911 Aug 29 19:21:04.116318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 24/56] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:03 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:04.160884 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:04.171289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:04.173046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:04.174491 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0184a506-a163-414e-b24f-06542ba75d6c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.118189 Aug 29 19:21:04.187342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 33/57] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:04 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:05.069824 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:05.071084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:05.078282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:05.078915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:05.081022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:05.081022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:05.081022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:05.081022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:05.126152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:05.130587 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:05.140239 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:05.140975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:05.141787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:05.142676 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:05.143288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:05.144489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:05.479960 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:05.502620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e11e9276-5790-48b8-b2c1-511c478d7fc6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.436875 Aug 29 19:21:05.505874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 25/58] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:05 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:05.509885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:05.522409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1e357d0f-447b-4284-b545-6bfa2061c825 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.401321 Aug 29 19:21:05.523132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 34/59] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:05 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:05.528982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:05.530091 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:05.545382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:05.548986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:05.549910 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:05.552787 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:05.553438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:05.554016 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:05.703643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:05.717298 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:05.721236 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:05.722899 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-514771e9-bce4-459e-bb24-1b61aa3d0bcb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.214879 Aug 29 19:21:05.728822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 26/60] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:05 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:06.526351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:06.527210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:06.538757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:06.539266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:06.539703 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:06.540766 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:06.541558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:06.542666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:06.543395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:06.544112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:06.553473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:06.553976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:06.554449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:06.558070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:06.558070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:06.558070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:06.837264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:06.840105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:06.848701 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b895899e-e0d8-4ae3-8525-00ef5e916dcf tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.309069 Aug 29 19:21:06.849316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 27/61] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:06 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:06.854471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:06.855102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:06.859843 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3da98b0a-1d36-4ef4-a252-9fd947bc9d06 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.337780 Aug 29 19:21:06.860558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 35/62] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:06 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:06.874501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:06.875014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:06.875479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:06.876225 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:06.876689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:06.877120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:06.954729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:06.963550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:06.965484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:06.966591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ff6f1f14-3e9f-446a-88e2-1fd1200fbd0d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.115968 Aug 29 19:21:06.967149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 28/63] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:06 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:07.881898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:07.882519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:07.883752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:07.884739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:07.892002 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:07.895724 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:07.895724 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:07.896313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:07.896393 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:07.896503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:07.896503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:07.896640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:07.897107 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:07.900646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:07.905294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:07.906667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:08.199447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:08.207497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:08.231891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-92ebbdab-3ca2-424d-9e7c-8c69106c9118 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.351883 Aug 29 19:21:08.240245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-48ad1880-84cc-4088-88c9-adf827dd2b4b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.347466 Aug 29 19:21:08.241212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 36/64] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:07 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:08.242745 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 29/65] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:07 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:08.252592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:08.254089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:08.279317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:08.282067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:08.282717 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:08.283428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:08.283925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:08.284356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:08.379122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:08.383596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:08.399644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:08.399644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:08.399644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b31c8dea-9f72-405f-880a-f25d5ce368a2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.156630 Aug 29 19:21:08.399980 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 37/66] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:08 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:09.270988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:09.272268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:09.272863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:09.274260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:09.277152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=16 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:09.280726 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:09.281361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:09.281797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:09.282377 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:09.282972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:09.283266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:09.284062 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:09.285108 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:09.285421 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:09.285830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:09.286166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:09.286929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:09.560331 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:09.570387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d1ef7490-2262-479d-9f6c-8a9fe7ca4d38 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.299341 Aug 29 19:21:09.574843 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 38/67] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:09 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:09.587047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:09.587833 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:09.609480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:09.615116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:09.615953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:09.617133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:09.618129 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:09.618905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:09.642886 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:09.653076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-503082f6-3b23-467b-b3f5-bc1b4881cc74 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.387163 Aug 29 19:21:09.654336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 30/68] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:09 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:09.711696 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:09.716889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:09.718609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:09.719714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1cafaae1-c7c2-4210-84a5-2a81ea1b0091 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.145830 Aug 29 19:21:09.720536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 39/69] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:09 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:10.594613 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:10.595203 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:10.598531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=28 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:10.602358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:10.602839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:10.603257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:10.603953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:10.607460 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:10.607940 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:10.678596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:10.679308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:10.691410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:10.692025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:10.692594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:10.693429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:10.694065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:10.694763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:10.894950 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:10.906092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2c3b907b-4d86-4457-97b6-d24a8b2007a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.315152 Aug 29 19:21:10.908527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 31/70] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:10 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:10.917854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:10.917854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:10.927331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:10.928299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:10.928870 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:10.929956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:10.930413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:10.930893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:10.939701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:10.950062 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ca91cdd7-acc7-495d-a6af-2aaf67842801 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.276520 Aug 29 19:21:10.951507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 40/71] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:10 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:11.004012 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:11.016387 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:11.018051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:11.019898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5bd13ae2-41f5-4345-a94b-a0b7c5ce42e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.106793 Aug 29 19:21:11.020402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 32/72] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:10 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:11.940499 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:11.941155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:11.948924 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:11.949416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:11.949848 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:11.950542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:11.951003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:11.951430 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:11.970629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:11.971341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:11.977400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:11.978165 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:11.978621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:11.979315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:11.979763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:11.980210 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:12.147443 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:12.155380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f2c70eb7-e16f-48af-ab61-f9eda46e2da3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.218797 Aug 29 19:21:12.156267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 41/73] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:11 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:12.159086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:12.164054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:12.164815 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:12.172174 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-91e0a097-9397-4b8e-8b31-b23f70926b9e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.205301 Aug 29 19:21:12.172747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:12.172876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 33/74] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:11 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:12.173604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:12.174043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:12.174966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:12.181030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:12.181687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:12.247020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:12.254454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:12.255933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:12.257018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0bf397ff-ab22-4f2c-84c7-0e6fd7d46e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.099843 Aug 29 19:21:12.257753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 42/75] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:12 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:13.176525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:13.177134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:13.180554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:13.184356 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:13.184839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:13.185431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:13.186125 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:13.186574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:13.186995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:13.195109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:13.196344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:13.203576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:13.204185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:13.204700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:13.205487 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:13.206025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:13.207049 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:13.406921 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:13.497832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:13.505194 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ffa447e9-b40e-4f50-8905-048118fcb2ad tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.314603 Aug 29 19:21:13.506077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 43/76] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:13 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:13.517052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:13.517052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9e1dc6d5-1d09-47f4-871d-37a1db44edf2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.343162 Aug 29 19:21:13.517052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 34/77] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:13 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:13.521240 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:13.522183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:13.545645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:13.549091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:13.549091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:13.549091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:13.549091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:13.549493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:13.646488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:13.654506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:13.669584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:13.669584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fad7fb5f-6696-46c3-b4ec-b61d799fb32d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1284 microversion: 2.20 time: 0.150061 Aug 29 19:21:13.669584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 44/78] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:13 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:14.530506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:14.531709 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:14.538472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:14.538889 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:14.539084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:14.539923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:14.540368 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:14.541274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:14.541725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:14.542309 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:14.545615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:14.553291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:14.554181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:14.555457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:14.556853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:14.557523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:14.558166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:15.089666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:15.099138 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:15.099758 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-81b52c69-95ff-4da1-8fe0-da92f3fd7a1d tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.566123 Aug 29 19:21:15.100363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 45/79] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:14 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:15.113802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:15.114371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:15.122983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-82b0d4b0-84fc-4b4d-ae5c-d51ed6d6f3e0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.596461 Aug 29 19:21:15.125001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 35/80] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:14 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:15.132917 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:15.133409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:15.133848 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:15.134545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:15.135015 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:15.135446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:15.230862 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:15.240577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:15.242418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:15.246297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-00d9e97e-d8a1-4dcc-8d17-feb75e7f62f9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1332 microversion: 2.20 time: 0.138964 Aug 29 19:21:15.246297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 46/81] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:15 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:15.663453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-b50cf0ad-b741-4fa9-abfc-d13053772261 req-b23f9263-e1cf-4f84-b710-fe7bd4d6afce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f63a8f7-75a2-42ee-9699-a63c55b8c3ca", "tag": "e3c64814-c08c-4b81-a5c7-4cbbce758a07"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:15.674044 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b50cf0ad-b741-4fa9-abfc-d13053772261 req-b23f9263-e1cf-4f84-b710-fe7bd4d6afce service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:15.674861 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b50cf0ad-b741-4fa9-abfc-d13053772261 req-b23f9263-e1cf-4f84-b710-fe7bd4d6afce service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:15.675459 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b50cf0ad-b741-4fa9-abfc-d13053772261 req-b23f9263-e1cf-4f84-b710-fe7bd4d6afce service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:15.680724 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:15.689793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-b50cf0ad-b741-4fa9-abfc-d13053772261 req-b23f9263-e1cf-4f84-b710-fe7bd4d6afce service nova] Creating event network-changed:e3c64814-c08c-4b81-a5c7-4cbbce758a07 for instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca on hv-cinder-85501 Aug 29 19:21:15.696283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-b50cf0ad-b741-4fa9-abfc-d13053772261 req-b23f9263-e1cf-4f84-b710-fe7bd4d6afce service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137122 Aug 29 19:21:15.697340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 36/82] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:16.121337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:16.121943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:16.127774 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:16.128797 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:16.129230 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:16.129908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:16.130355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:16.130772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:16.150855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:16.151676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:16.158352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:16.158963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:16.159534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:16.160343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:16.160862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:16.161284 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:16.331387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:16.340627 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b55f85db-3d2e-44fc-9e3c-cfa7e87decf1 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.223238 Aug 29 19:21:16.341212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 47/83] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:16 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:16.345436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:16.396001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:16.396001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:16.396001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:16.396001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:16.396954 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:16.397212 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8b48fc17-e1ad-45bf-a3f6-dd73f4a1bbf5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.206919 Aug 29 19:21:16.397291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:16.397371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 37/84] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:16 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:16.397452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:16.397452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:16.422433 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:16.431805 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:16.433299 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:16.434441 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0f0073bb-6dc8-4485-90eb-5ded225fbf0f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1350 microversion: 2.20 time: 0.092288 Aug 29 19:21:16.435029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 48/85] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:16 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:17.408334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:17.408865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:17.409202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:17.409342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:17.415434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.416068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.416185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.425765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.425906 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.426001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.426074 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.426154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.426154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.426292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.426292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.426292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.621738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:17.635956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:17.656466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5b37fda8-dce0-487e-9ca2-3a833f8e7f2a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.228066 Aug 29 19:21:17.668519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c3613c75-69d0-49a9-a666-170fe440e350 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.249895 Aug 29 19:21:17.668924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 38/86] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:17 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:17.669005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 49/87] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:17 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:17.674252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:17.675196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:17.685806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.686593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.687158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.688081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.688752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.689384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.728660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5054f226-cc23-4016-ac32-5461f6cd50b4", "tag": "958285db-a662-4674-b8ba-03aeaded321b"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:17.754277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.756831 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.757673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.782191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Creating event network-changed:958285db-a662-4674-b8ba-03aeaded321b for instance 5054f226-cc23-4016-ac32-5461f6cd50b4 on hv-cinder-85501 Aug 29 19:21:17.782883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 19:21:17.783644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-06320ebe-0a1e-402c-a9ed-2e95b1e3285c req-ab1c12c0-fa87-4f5c-b1ac-c6dede635d29 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 19:21:17.785055 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.785945 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.786669 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.787802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:17.789530 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:17.789530 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:17.801274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.compute.rpcapi [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 19:21:17.802509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] Releasing lock "compute-rpcapi-router" {{(pid=121336) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 19:21:17.820740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:17.833651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:17.837164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:17.840793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1b7bc0dd-d2c7-4ffe-b80e-51770fa71e37 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1350 microversion: 2.20 time: 0.178795 Aug 29 19:21:17.843801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bd007f87-630d-4f9a-9a9c-ef84a4a39e09 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120637 Aug 29 19:21:17.847109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 39/88] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:17 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:17.847230 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 50/89] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:21:18.683161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:18.688153 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:18.688286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:18.688286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:18.691158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:18.692002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:18.692648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:18.693527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:18.694182 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:18.694823 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:18.695127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:18.695759 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:18.696958 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:18.697762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:18.698320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:18.698860 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:18.906964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:18.925523 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:18.930488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b79c12bd-703d-46f9-8994-8bd12bad1380 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.245801 Aug 29 19:21:18.932581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 51/90] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:18 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:18.943340 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:18.945902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:18.946434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f1f6cc02-1f39-4740-b2af-1148cc84dde2 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.268478 Aug 29 19:21:18.947488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 40/91] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:18 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:18.966033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:18.966530 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:18.966959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:18.967807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:18.968552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:18.968977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:19.145532 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:19.154233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:19.155671 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:19.156868 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1ef65b2d-d721-481d-a301-51fb2a122a13 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.222153 Aug 29 19:21:19.157477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 52/92] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:18 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:19.929111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-9f409444-f4e3-4f0a-aade-065de6d593db req-6ce32986-370f-4153-9c88-2a477472419f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:19.939140 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9f409444-f4e3-4f0a-aade-065de6d593db req-6ce32986-370f-4153-9c88-2a477472419f service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:19.939609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9f409444-f4e3-4f0a-aade-065de6d593db req-6ce32986-370f-4153-9c88-2a477472419f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:19.940067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9f409444-f4e3-4f0a-aade-065de6d593db req-6ce32986-370f-4153-9c88-2a477472419f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:19.952276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-9f409444-f4e3-4f0a-aade-065de6d593db req-6ce32986-370f-4153-9c88-2a477472419f service nova] Creating event network-changed:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:21:19.952471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:19.953086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:19.957961 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-9f409444-f4e3-4f0a-aade-065de6d593db req-6ce32986-370f-4153-9c88-2a477472419f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032493 Aug 29 19:21:19.958561 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 41/93] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:19.961409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:19.961409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:19.961409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:19.963141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:19.963472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:19.964041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:19.973704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:19.974468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:19.982704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:19.995665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:19.995665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:19.995665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:19.995665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:19.996188 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:20.168070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:20.176436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bc990aeb-a59f-4dec-a91a-43f839b6d067 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.227889 Aug 29 19:21:20.177004 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 53/94] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:19 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:20.180146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:20.181937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:20.182555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:20.191012 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:20.191367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3baf989e-1d19-4db8-ab7d-60ca39c1ecdb tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.225061 Aug 29 19:21:20.191834 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:20.192182 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 42/95] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:19 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:20.192302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:20.193155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:20.193613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:20.194033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:20.369720 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:20.374942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:20.381226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:20.382665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:20.383785 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-76c1c0f8-542e-4e1f-88c8-0c2b825ca666 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.205533 Aug 29 19:21:20.384360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 54/96] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:20 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:21.197740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:21.200087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:21.218411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:21.219175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:21.233039 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:21.234912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:21.238825 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:21.239516 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:21.239694 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:21.240352 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:21.241283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:21.242154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:21.242769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:21.243385 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:21.244447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:21.245124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:21.508194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:21.510754 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:21.519797 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-29a01d5f-f3df-4a1b-8985-f984aad6f9e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.304897 Aug 29 19:21:21.524233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ae891a5d-af57-424e-a606-856fafd58329 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.330145 Aug 29 19:21:21.524844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 43/97] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:21 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:21.530106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:21.530704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:21.537544 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:21.542705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:21.542705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:21.542705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:21.542705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:21.543055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:21.543141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 55/98] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:21 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:21.866878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:21.879785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:21.881877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:21.885482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bcd504c8-9504-4e45-a2a7-c5419447b80c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.359341 Aug 29 19:21:21.889377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 44/99] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:21 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:22.553224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:22.553224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:22.553705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:22.553705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:22.567366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:22.567879 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:22.568320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:22.569144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:22.569601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:22.570018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:22.574321 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:22.576342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:22.577080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:22.579358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:22.580563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:22.581819 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:23.024974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:23.035684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0e0becf8-630a-462c-b16d-3d342d1801e5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.496143 Aug 29 19:21:23.037737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 56/100] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:22 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:23.043942 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:23.044291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:23.045053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:23.053577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:23.054648 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:23.054879 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:23.055614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:23.056091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:23.056497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:23.057145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-445ca417-3fb2-49fc-87bb-f4913482768b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.510209 Aug 29 19:21:23.059557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 45/101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:22 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:23.270912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:23.287489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:23.289299 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:23.290577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8298ead4-2eff-4b65-b696-83e58cf22952 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.251712 Aug 29 19:21:23.291125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 57/102] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:23 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:24.057791 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:24.058421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:24.064439 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:24.064915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:24.065911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:24.066590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:24.067034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:24.067455 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:24.083593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:24.084209 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:24.090349 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:24.090833 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:24.092931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:24.092931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:24.092931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:24.092931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:24.281149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:24.285019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:24.292799 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4b19cd7c-d4fd-4cf3-9c8a-e19620a91db3 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.238678 Aug 29 19:21:24.293147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7beddf59-3259-4232-9ab4-20d1661a54ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.213309 Aug 29 19:21:24.294156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 46/103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:24 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:24.304524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 58/104] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:24 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:24.314999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:24.315774 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:24.323684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:24.324205 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:24.328051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:24.328051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:24.328051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:24.328051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:24.469411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:24.479052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:24.480882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:24.482042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-122a275e-b6f1-4865-9fd2-f0c1e512e072 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.170997 Aug 29 19:21:24.482695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 47/105] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:24 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:25.315756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:25.316363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:25.316773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:25.316866 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:25.325162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:25.326345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:25.326793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:25.327368 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:25.327581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:25.328375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:25.328488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:25.329049 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:25.329727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:25.331396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:25.333396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:25.334357 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:25.651554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:25.663625 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ccac4e64-bb28-4fa3-882f-5b05ca510ec5 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.352483 Aug 29 19:21:25.665267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 48/106] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:25 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:25.665998 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:25.694468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-166a6fdd-b981-4674-bd75-5f6a2ef282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.380397 Aug 29 19:21:25.698128 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 59/107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:25 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:25.717388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:25.720859 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:25.734677 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:25.740407 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:25.741073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:25.743495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:25.744873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:25.745906 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:25.912535 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:25.921771 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:25.923445 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:25.925393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3c3a0882-116d-46dd-8c18-b3e729bb2432 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.225538 Aug 29 19:21:25.926121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 60/108] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:25 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:26.031478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-6eb9dde8-1177-4476-8cd4-4206d7a83369 req-40f55a92-2d2a-4eff-ae13-6b79bf62857c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03815042-41b5-4e56-a2cc-fa3223abbb2b", "name": "network-vif-plugged", "status": "completed", "tag": "cfd33ea2-8339-4abc-9b9c-942cf02465d8"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:26.042932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-6eb9dde8-1177-4476-8cd4-4206d7a83369 req-40f55a92-2d2a-4eff-ae13-6b79bf62857c service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.043541 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-6eb9dde8-1177-4476-8cd4-4206d7a83369 req-40f55a92-2d2a-4eff-ae13-6b79bf62857c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.044531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-6eb9dde8-1177-4476-8cd4-4206d7a83369 req-40f55a92-2d2a-4eff-ae13-6b79bf62857c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.057088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-6eb9dde8-1177-4476-8cd4-4206d7a83369 req-40f55a92-2d2a-4eff-ae13-6b79bf62857c service nova] Creating event network-vif-plugged:cfd33ea2-8339-4abc-9b9c-942cf02465d8 for instance 03815042-41b5-4e56-a2cc-fa3223abbb2b on hv-cinder-85501 Aug 29 19:21:26.062564 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-6eb9dde8-1177-4476-8cd4-4206d7a83369 req-40f55a92-2d2a-4eff-ae13-6b79bf62857c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395815 Aug 29 19:21:26.063777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 49/109] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:26.688711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:26.689313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:26.695828 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.696349 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.696782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.697673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.698152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.698576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.719944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:26.721073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:26.729031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.729694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.730238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.731476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.731962 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.732434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.937551 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:26.946718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-321ecda3-6fd4-48e9-877b-29c91cd90a48 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.262617 Aug 29 19:21:26.947295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 61/110] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:26 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:26.952769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:26.953308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:26.960327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.961063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.961493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.962839 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:26.963295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:26.963714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:26.978401 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:26.997112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e0b0bb39-b265-4cf4-85fe-585e0ce8b2e1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.281772 Aug 29 19:21:26.997897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 50/111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:26 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:27.138532 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:27.148402 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:27.150043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:27.151363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b15b1103-4358-4bc0-9a4a-dd2311983913 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.203122 Aug 29 19:21:27.152033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 62/112] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:26 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:27.969336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:27.970316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:27.977345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:27.977826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:27.978278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:27.978967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:27.979412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:27.979827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:28.018925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:28.019524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:28.021515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:28.027400 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:28.027988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:28.028420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:28.029442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:28.031095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:28.031553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:28.186436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:28.195682 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ebbe8bc0-8bcb-4e8b-ad36-e749dad5a6a9 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.230666 Aug 29 19:21:28.196290 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 51/113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:27 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:28.200685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-94667cce-babe-4667-b38f-d9e0c2ee3577 req-86389c31-f666-473e-874f-2fbd5baa35af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f63a8f7-75a2-42ee-9699-a63c55b8c3ca", "name": "network-vif-plugged", "status": "completed", "tag": "e3c64814-c08c-4b81-a5c7-4cbbce758a07"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:28.209934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-94667cce-babe-4667-b38f-d9e0c2ee3577 req-86389c31-f666-473e-874f-2fbd5baa35af service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:28.210400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-94667cce-babe-4667-b38f-d9e0c2ee3577 req-86389c31-f666-473e-874f-2fbd5baa35af service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:28.210867 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-94667cce-babe-4667-b38f-d9e0c2ee3577 req-86389c31-f666-473e-874f-2fbd5baa35af service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:28.222615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:28.222822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-94667cce-babe-4667-b38f-d9e0c2ee3577 req-86389c31-f666-473e-874f-2fbd5baa35af service nova] Creating event network-vif-plugged:e3c64814-c08c-4b81-a5c7-4cbbce758a07 for instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca on hv-cinder-85501 Aug 29 19:21:28.230493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-94667cce-babe-4667-b38f-d9e0c2ee3577 req-86389c31-f666-473e-874f-2fbd5baa35af service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Aug 29 19:21:28.230968 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 52/114] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:28.237461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:28.238212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-503f7645-3617-40d7-8b40-756d5275f314 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.223064 Aug 29 19:21:28.238764 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:28.238884 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 63/115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:28 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:28.247939 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:28.252337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:28.252337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:28.252337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:28.252337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:28.253295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:28.408833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:28.417158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:28.418583 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:28.419683 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3c4b12e3-05d3-4f54-b980-b4067e5d6af2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.187441 Aug 29 19:21:28.420380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 53/116] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:28 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:29.216597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:29.217216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:29.224053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:29.224533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:29.224991 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:29.225681 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:29.226132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:29.226550 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:29.261238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:29.261866 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:29.272438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:29.272929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:29.273498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:29.274200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:29.274848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:29.275258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:29.439821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:29.449456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e4471228-ead1-4cd6-b784-c9148a555423 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.237069 Aug 29 19:21:29.450185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 64/117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:29 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:29.455046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:29.456600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:29.462801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:29.463343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:29.463832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:29.464600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:29.465480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:29.466178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:29.479419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:29.491276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4634f2e5-5e9e-48f3-9b4f-5fe0bc730186 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.233786 Aug 29 19:21:29.491915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 54/118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:29 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:29.624420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:29.636002 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:29.641581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:29.644959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8c99f76b-5010-4100-8537-4f51622f2309 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.193551 Aug 29 19:21:29.645793 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 65/119] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:29 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:30.470865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:30.472241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:30.478456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:30.478983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:30.486812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:30.486812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:30.486812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:30.486812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:30.500651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:30.512444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:30.513313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:30.520044 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:30.521475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:30.521475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:30.522021 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:30.522250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:30.522575 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:30.676092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:30.716271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2e0d1f5b-281f-47e2-8a06-69bc5ee79859 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.247066 Aug 29 19:21:30.717528 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 55/120] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:30 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:30.723150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:30.723828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:30.733058 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:30.736739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:30.740855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:30.740855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:30.740855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:30.740855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:30.741199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:30.741655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3383a25c-997d-4720-bf17-4c743200c456 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.232907 Aug 29 19:21:30.742559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 66/121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:30 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:30.874925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:30.883670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:30.885158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:30.886246 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a3e1c28b-eab0-4c78-b4cb-a37df56aa62e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.167476 Aug 29 19:21:30.886806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 56/122] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:30 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:31.745234 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:31.745896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:31.751928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:31.752410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:31.752832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:31.753518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:31.753966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:31.754403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:31.766401 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:31.767150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:31.775364 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:31.776277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:31.776762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:31.779789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:31.779789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:31.779789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:31.938465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:31.947937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5f7fece1-a372-48f1-bc3c-238bb8f13b80 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.206179 Aug 29 19:21:31.959491 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 67/123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:31 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:31.963246 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:31.967424 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:31.974617 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:31.975312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:31.975522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:31.976247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:31.976854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:31.977422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:31.978953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:32.003823 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2eabc205-d6f8-428b-9767-e59469e5de9d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.241298 Aug 29 19:21:32.004833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 57/124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:31 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:32.135452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:32.144363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:32.145873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:32.146969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-194b746b-1041-49d4-b497-ce92e3416f67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.187680 Aug 29 19:21:32.147523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 68/125] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:31 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:32.364538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-b3e3839c-e25a-4f62-b388-fec870e9dd73 req-f370497f-615d-40a6-9c5c-28c8776b27f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "name": "network-vif-plugged", "status": "completed", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:32.382017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b3e3839c-e25a-4f62-b388-fec870e9dd73 req-f370497f-615d-40a6-9c5c-28c8776b27f5 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:32.382572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b3e3839c-e25a-4f62-b388-fec870e9dd73 req-f370497f-615d-40a6-9c5c-28c8776b27f5 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:32.383010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b3e3839c-e25a-4f62-b388-fec870e9dd73 req-f370497f-615d-40a6-9c5c-28c8776b27f5 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:32.401527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-b3e3839c-e25a-4f62-b388-fec870e9dd73 req-f370497f-615d-40a6-9c5c-28c8776b27f5 service nova] Creating event network-vif-plugged:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:21:32.401527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-b3e3839c-e25a-4f62-b388-fec870e9dd73 req-f370497f-615d-40a6-9c5c-28c8776b27f5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045230 Aug 29 19:21:32.401527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 58/126] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:21:32.986175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:32.986175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:32.986175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:32.986175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:32.987170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:32.987170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:32.987170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:32.987783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:33.025111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:33.026160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:33.035582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:33.040102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:33.040102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:33.040102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:33.040102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:33.040496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:33.272730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:33.280375 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-42d72228-4698-4ae1-b156-ccdcc3e07e4e tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.309801 Aug 29 19:21:33.280936 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 69/127] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:32 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:33.287821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:33.288661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:33.304880 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:33.313995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:33.316678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:33.320578 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:33.322987 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:33.324375 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:33.325780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:33.328427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-60c8b9b6-1025-4be5-87e1-60b3595f46c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.306657 Aug 29 19:21:33.331811 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 59/128] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:33 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:33.529722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:33.539835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:33.541395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:33.542837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-068de91b-2389-4638-b458-5dfd7563e19f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.260604 Aug 29 19:21:33.543573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 70/129] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:33 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:34.315317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:34.315967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:34.322318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:34.322802 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:34.323406 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:34.324200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:34.324657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:34.325082 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:34.354082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:34.359108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:34.378736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:34.384314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:34.385193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:34.386523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:34.388125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:34.389020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:34.461053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:34.572249 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:34.582253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-dab80c24-2503-43b3-a8c1-0377574cdd94 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1315 microversion: 2.1 time: 0.271243 Aug 29 19:21:34.582829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 60/130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:34 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:34.591623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:34.608545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:34.609432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:34.609928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:34.610352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:34.611042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:34.611482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:34.614079 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:34.672966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:34.684217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-452947b4-d1bb-423f-b885-2ee491660f7a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.334632 Aug 29 19:21:34.685208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 71/131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:34 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:34.790077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:34.799536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:34.801563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:34.802930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cdea2986-2b89-436e-b674-9fa5bd308b3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.219179 Aug 29 19:21:34.816798 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 61/132] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:34 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:35.604783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:35.605394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:35.617621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.618200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.618632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.619272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.619724 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.620172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.706307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:35.706907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:35.713046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.713529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.713964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.715101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.715101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.715639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.791737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:35.801549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e5e21524-5180-4ad9-8904-d43fc220aced tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1502 microversion: 2.1 time: 0.200655 Aug 29 19:21:35.804376 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 72/133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:35 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:35.832432 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:35.833148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:35.841036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.841579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.842060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:35.842959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:35.843440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:35.843895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:36.224718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:36.234152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7d4b7ea0-8d5e-43d4-b875-8457d98f7941 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.531682 Aug 29 19:21:36.235519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 62/134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:35 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:36.256928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:36.265942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:36.267456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:36.269331 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-17985eb8-11b6-4271-8b32-c3209cdf35b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.443496 Aug 29 19:21:36.269972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 73/135] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:35 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:21:36.312010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-9809f836-7e7f-4446-af46-b171e61b94bf req-67197418-6902-4528-95b3-b3e4781a9eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5054f226-cc23-4016-ac32-5461f6cd50b4", "name": "network-vif-plugged", "status": "completed", "tag": "958285db-a662-4674-b8ba-03aeaded321b"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:36.322177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9809f836-7e7f-4446-af46-b171e61b94bf req-67197418-6902-4528-95b3-b3e4781a9eaa service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:36.322678 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9809f836-7e7f-4446-af46-b171e61b94bf req-67197418-6902-4528-95b3-b3e4781a9eaa service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:36.323095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9809f836-7e7f-4446-af46-b171e61b94bf req-67197418-6902-4528-95b3-b3e4781a9eaa service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:36.334921 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-9809f836-7e7f-4446-af46-b171e61b94bf req-67197418-6902-4528-95b3-b3e4781a9eaa service nova] Creating event network-vif-plugged:958285db-a662-4674-b8ba-03aeaded321b for instance 5054f226-cc23-4016-ac32-5461f6cd50b4 on hv-cinder-85501 Aug 29 19:21:36.339729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-9809f836-7e7f-4446-af46-b171e61b94bf req-67197418-6902-4528-95b3-b3e4781a9eaa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 Aug 29 19:21:36.340331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 63/136] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:37.256630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:37.257226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:37.263624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:37.264208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:37.264704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:37.265442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:37.265902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:37.266357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:37.293328 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:37.295041 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:37.302340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:37.302824 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:37.303461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:37.304472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:37.305358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:37.305944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:37.505042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:37.508930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:37.516194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:37.517066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bfc3a191-0a7b-4681-8bef-ad762e7aa30a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.264843 Aug 29 19:21:37.517611 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:37.517750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 74/137] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:37 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:37.518919 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ea70da40-9ae8-418c-8263-0a2578c232ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1406 microversion: 2.20 time: 0.230181 Aug 29 19:21:37.519486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 64/138] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:37 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:21:38.538549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:38.539056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:38.542298 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:38.542686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:38.545253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:38.545730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:38.546155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:38.546837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:38.547285 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:38.547697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:38.548379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:38.548857 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:38.549286 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:38.549980 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:38.550434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:38.550896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:38.757052 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:38.765002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:38.765154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-196b2f49-2372-4e74-a4a8-ab3b27b37e60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.230497 Aug 29 19:21:38.765609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 75/139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:38 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:38.774332 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:38.776048 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:38.777362 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b70f2509-5962-4e83-8a9c-7249023fa327 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1597 microversion: 2.20 time: 0.239477 Aug 29 19:21:38.784030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 65/140] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:21:38 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1597 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:21:38.801024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:38.801510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:38.807814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:38.808406 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:38.808941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:38.810067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:38.810523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:38.810944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:38.936136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-94843397-e447-44ae-92c3-a38f6bc38a21 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.138968 Aug 29 19:21:38.936738 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 76/141] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 19:21:38 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:21:39.596884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cff82bd1-a90e-4ea6-8852-0f1bcdb93aad"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:39.599218 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:39.614453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:39.614947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:39.616376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:39.617086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:39.617539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:39.617987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:39.788987 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:39.789805 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:39.798066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:39.799446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:39.800209 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:39.801211 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:39.802056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:39.803253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:40.144678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:40.153477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c83d58ff-39df-4c72-9958-11797966a1c4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1321 microversion: 2.1 time: 0.370107 Aug 29 19:21:40.154242 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 77/142] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:39 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:40.672424 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-68a0b914-195b-441a-95d2-69b92cd8a194 req-688299f7-05ca-4bd6-ada8-6cc59b11a2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:40.685471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-68a0b914-195b-441a-95d2-69b92cd8a194 req-688299f7-05ca-4bd6-ada8-6cc59b11a2a7 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:40.694492 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-68a0b914-195b-441a-95d2-69b92cd8a194 req-688299f7-05ca-4bd6-ada8-6cc59b11a2a7 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:40.704535 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-68a0b914-195b-441a-95d2-69b92cd8a194 req-688299f7-05ca-4bd6-ada8-6cc59b11a2a7 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:40.729238 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-68a0b914-195b-441a-95d2-69b92cd8a194 req-688299f7-05ca-4bd6-ada8-6cc59b11a2a7 service nova] Creating event network-changed:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:21:40.736076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-68a0b914-195b-441a-95d2-69b92cd8a194 req-688299f7-05ca-4bd6-ada8-6cc59b11a2a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065958 Aug 29 19:21:40.737147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 78/143] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:21:41.025937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-864238b2-a172-4247-a6cf-7ae09a3d349a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "POST /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.443442 Aug 29 19:21:41.028223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 66/144] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:21:39 2022] POST /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b/os-volume_attachments => generated 194 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:41.177284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:41.178560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:41.185361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:41.185997 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:41.186606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:41.187883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:41.188341 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:41.188762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:41.491256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:41.499234 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3e6279d5-02ae-4f83-8013-80c7b187df29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1514 microversion: 2.1 time: 0.328037 Aug 29 19:21:41.499723 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 79/145] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:41 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:41.521786 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:41.524184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:41.532261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:41.532778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:41.533763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:41.534622 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:41.535065 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:41.541270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:41.563143 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'flavor' on Instance uuid 5054f226-cc23-4016-ac32-5461f6cd50b4 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:21:42.242794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-adabc8f3-3faf-4f4d-a917-46ce0114bd20 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4/action" status: 200 len: 32 microversion: 2.1 time: 0.725811 Aug 29 19:21:42.243576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 67/146] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:21:41 2022] POST /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4/action => generated 32 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:21:42.252965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:42.253565 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:42.259445 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:42.259978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:42.260468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:42.261061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:42.261522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:42.262040 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:42.608317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:42.616465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-29521862-862c-4a49-82c2-b38eb9b2f628 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.367317 Aug 29 19:21:42.617033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 80/147] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:42 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:43.638907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:43.640244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:43.653747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:43.655574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:43.656418 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:43.658796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:43.659552 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:43.660585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:43.839057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:43.848909 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6bf4865c-cd82-4208-a4e6-eb3b7ba1eda3 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.214796 Aug 29 19:21:43.861348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 68/148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:43 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:44.873850 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:44.884014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:44.884014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:44.884014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:44.884014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:44.884381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:44.884381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:44.884381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:45.027011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:45.034973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3f3ad0aa-2372-4245-9119-ac4a404738b7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.164891 Aug 29 19:21:45.035540 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 81/149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:44 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:46.057468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:46.059023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:46.066557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.067120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.067629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.068438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:46.068955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:46.069382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:46.234696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:46.243567 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-01a7a761-9cf9-41ad-8f1f-034a38a4bc40 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.191481 Aug 29 19:21:46.244586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 69/150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:46 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:47.274082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:47.274835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:47.281277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:47.282089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:47.282602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:47.284493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:47.284493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:47.284493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:47.491024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:47.499791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5318c9ec-2134-437c-80d9-8ef0301ef4d4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.230103 Aug 29 19:21:47.500417 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 82/151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:47 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:48.522275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:48.522813 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:48.529437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:48.529930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:48.530367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:48.531119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:48.531600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:48.532056 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:48.536551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:48.680836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:48.692375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6f0594dc-eb5a-41e9-ad2c-31386e9dfc70 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.174928 Aug 29 19:21:48.707104 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 70/152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:48 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:49.715571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:49.717087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:49.724921 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:49.727650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:49.727650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:49.727650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:49.727650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:49.728871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:49.885103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:49.895984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9af16987-a20e-431f-86c9-fd15e6ae217f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.185053 Aug 29 19:21:49.908372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 83/153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:49 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:50.919366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:50.920003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:50.923886 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=73 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:50.927784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:50.928280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:50.928704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:50.930256 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:50.930256 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:50.930256 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:51.087572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:51.096229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-06f4e5df-0515-4356-9201-1898a8b282b1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.179828 Aug 29 19:21:51.097975 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 71/154] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:50 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:52.118660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:52.119339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:52.124593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=78 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:52.127279 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.127821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.128407 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.129147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.129603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.130026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.277368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:52.286219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7b67c827-ebb4-4c22-98cd-e88730ffd297 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.171863 Aug 29 19:21:52.287013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 84/155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:52 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:52.790248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:52.791740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:52.801995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.802499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.802934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.803672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:52.804319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:52.804735 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:52.834875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:21:53.174201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d078fdf4-cf41-4e71-8814-2b1d9d5c716a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "DELETE /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 204 len: 0 microversion: 2.1 time: 0.387491 Aug 29 19:21:53.175005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 72/156] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:21:52 2022] DELETE /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:21:53.183513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:53.184149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:53.191388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:53.191897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:53.192722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:53.193599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:53.194495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:53.194965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:53.310055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:53.311199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:53.323142 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:53.324563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:53.325027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:53.326306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:53.327073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:53.327669 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:53.374224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:53.384816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-92b3edc6-2a9a-4e4c-b1bc-a48562ac6f26 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1554 microversion: 2.1 time: 0.204992 Aug 29 19:21:53.399022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 85/157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:53 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:53.499620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:53.507682 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1d57c4b3-b634-4c66-a634-a2ffc11e4fc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.202617 Aug 29 19:21:53.508445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 73/158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:53 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:54.406501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:54.407118 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:54.423439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.423439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.423439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.424301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.425029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.425666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.533800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:54.535176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:54.542795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.543402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.543839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.544752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:54.545353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:54.545936 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:54.701654 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:54.711561 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8d243f31-f896-45b3-adab-88350179050b tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1554 microversion: 2.1 time: 0.309024 Aug 29 19:21:54.712580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 86/159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:54 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1554 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:54.784021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:54.793351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b7d9a1ce-cd23-4034-869d-7209011e9e63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.267982 Aug 29 19:21:54.807431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 74/160] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:54 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:55.735820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:55.736505 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:55.743926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.744764 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.745362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.746066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.746718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.747139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.815403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:55.816047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:55.823302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.824101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.824619 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:55.825333 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:55.825790 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:55.826214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:56.088488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:56.096749 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-679c52b5-b39a-4119-bdf0-45d0abe38f29 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1554 microversion: 2.1 time: 0.366044 Aug 29 19:21:56.108216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 87/161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:55 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1554 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:56.169305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:56.177624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b7381995-1c11-4111-8758-5bf86ee0b5fa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.366873 Aug 29 19:21:56.178212 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 75/162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:55 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:21:56.925886 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-b74f5d01-133c-431b-93e5-3eb3fcf9831f req-5748239c-e832-4b6c-a7b0-705774ddeb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03815042-41b5-4e56-a2cc-fa3223abbb2b", "name": "network-vif-deleted", "tag": "cfd33ea2-8339-4abc-9b9c-942cf02465d8"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:21:56.939521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b74f5d01-133c-431b-93e5-3eb3fcf9831f req-5748239c-e832-4b6c-a7b0-705774ddeb3f service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:56.939521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b74f5d01-133c-431b-93e5-3eb3fcf9831f req-5748239c-e832-4b6c-a7b0-705774ddeb3f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:56.939521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b74f5d01-133c-431b-93e5-3eb3fcf9831f req-5748239c-e832-4b6c-a7b0-705774ddeb3f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:56.957119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-b74f5d01-133c-431b-93e5-3eb3fcf9831f req-5748239c-e832-4b6c-a7b0-705774ddeb3f service nova] Creating event network-vif-deleted:cfd33ea2-8339-4abc-9b9c-942cf02465d8 for instance 03815042-41b5-4e56-a2cc-fa3223abbb2b on hv-cinder-85501 Aug 29 19:21:56.963056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-b74f5d01-133c-431b-93e5-3eb3fcf9831f req-5748239c-e832-4b6c-a7b0-705774ddeb3f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041406 Aug 29 19:21:56.964579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 88/163] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:21:57.120700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:57.121302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:57.128207 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:57.128690 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:57.129158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:57.129846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:57.130293 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:57.130715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:57.194988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:57.206300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6f0cf462-6fb3-4861-9b07-ed8dc9c2bd3a tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1346 microversion: 2.1 time: 0.089413 Aug 29 19:21:57.211096 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:57.211905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:57.216235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 76/164] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:57 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:57.221284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:57.221896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:57.222702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:57.224016 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:57.224940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:57.225946 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:57.401292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:57.404633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:57.410184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4418f55f-767f-4792-8c52-f20f9f67dc25 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.203842 Aug 29 19:21:57.423342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 89/165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:57 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:58.227832 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:58.228430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:58.235450 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:58.236651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:58.237577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:58.237910 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:58.238367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:58.238794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:58.273001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:58.273499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:58.274103 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:58.274564 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lazy-loading 'fault' on Instance uuid 03815042-41b5-4e56-a2cc-fa3223abbb2b {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:21:58.353124 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97d0910139b4610b792092b6133596d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991d9be87e5494588cafcdcd6841e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:58.368957 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3792a359-bff3-471d-aee8-95a1e645ecb6 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 200 len: 1351 microversion: 2.1 time: 0.143935 Aug 29 19:21:58.370222 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 77/166] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:58 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 1351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:58.430604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:58.431434 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:58.437850 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:58.440498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:58.441125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:58.441968 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:58.442524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:58.443075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:58.589761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:58.604878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-99523ad2-4a22-4fa6-8938-e276098f86a6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.177822 Aug 29 19:21:58.606009 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 90/167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:58 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:21:59.397353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:59.398752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:59.409513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:59.409513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:59.409513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:59.410713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:59.411437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:59.412171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:59.438513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] HTTP exception thrown: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Request method failure captured: Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b HTTP/1.1 Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGNIy4AqhLxmh1xyTD74Z6BNMA6Tix6e-vSnc0moMu30e8BCsLlVP6-2ZSJo6ElTSbdcZz-BspaX_ZFoYrWZ2SwM2KNbpw5A8t9rW-VkJqKq0g68yQkFKvbwUSe44FNuflZNVD5AW1mjCydagNdZPaLsVDKcDWbG5tVz3JWj8diwrI Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:21:59.468917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f991d9be87e5494588cafcdcd6841e7d"}]}] Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-DeleteServersTestJSON-168619910 Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: f97d0910139b4610b792092b6133596d Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.470703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '03815042-41b5-4e56-a2cc-fa3223abbb2b'} Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:59.471376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.473515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Returning 404 to user: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:59.473515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ee9d71d1-0c51-4e5c-9269-1b36ebb0c153 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 404 len: 111 microversion: 2.1 time: 0.078441 Aug 29 19:21:59.473515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 78/168] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:59 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:21:59.626061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:59.627353 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:59.636588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:59.637490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:59.638074 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:59.638925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:59.639522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:59.640132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:59.641090 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:21:59.646743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:21:59.663571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:59.664196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:59.665233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:59.666197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:21:59.666669 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:21:59.667643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:21:59.687066 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] HTTP exception thrown: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Request method failure captured: Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b/os-volume_attachments HTTP/1.1 Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGNIy4AqhLxmh1xyTD74Z6BNMA6Tix6e-vSnc0moMu30e8BCsLlVP6-2ZSJo6ElTSbdcZz-BspaX_ZFoYrWZ2SwM2KNbpw5A8t9rW-VkJqKq0g68yQkFKvbwUSe44FNuflZNVD5AW1mjCydagNdZPaLsVDKcDWbG5tVz3JWj8diwrI Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:21:59.689816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f991d9be87e5494588cafcdcd6841e7d"}]}] Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-DeleteServersTestJSON-168619910 Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: f97d0910139b4610b792092b6133596d Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.691275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'server_id': '03815042-41b5-4e56-a2cc-fa3223abbb2b'} Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:21:59.692093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:21:59.693385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:21:59.697603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Returning 404 to user: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:21:59.698480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d0526d0d-a4f4-45d3-9351-c41d4dac89d4 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061889 Aug 29 19:21:59.699346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 79/169] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:21:59 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:21:59.851473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:21:59.859394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e65c4405-1a4e-4431-871d-363ddc170693 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.237142 Aug 29 19:21:59.860235 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 91/170] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:21:59 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:00.882872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:00.883462 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:00.889928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:00.890414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:00.890846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:00.891693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:00.893461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:00.893900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:01.043565 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:01.053133 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-68419abb-de6a-4aec-9269-f4a85c5d635a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.176576 Aug 29 19:22:01.053723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 80/171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:00 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:01.634083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:01.634657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:01.640716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:01.641202 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:01.641664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:01.642445 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:01.642905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:01.643333 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:01.657174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] HTTP exception thrown: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Request method failure captured: Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b HTTP/1.1 Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGNIy4AqhLxmh1xyTD74Z6BNMA6Tix6e-vSnc0moMu30e8BCsLlVP6-2ZSJo6ElTSbdcZz-BspaX_ZFoYrWZ2SwM2KNbpw5A8t9rW-VkJqKq0g68yQkFKvbwUSe44FNuflZNVD5AW1mjCydagNdZPaLsVDKcDWbG5tVz3JWj8diwrI Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:22:01.662474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f991d9be87e5494588cafcdcd6841e7d"}]}] Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-DeleteServersTestJSON-168619910 Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: f97d0910139b4610b792092b6133596d Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.663933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '03815042-41b5-4e56-a2cc-fa3223abbb2b'} Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:22:01.664875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.666144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.668136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Returning 404 to user: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:22:01.668136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b298b0f4-bfbd-4540-8283-0eb8d9e07b86 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "DELETE /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 404 len: 111 microversion: 2.1 time: 0.033975 Aug 29 19:22:01.668136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 92/172] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:22:01 2022] DELETE /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:22:01.674772 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:01.675530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] [instance: 03815042-41b5-4e56-a2cc-fa3223abbb2b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:01.681749 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:01.682428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:01.682863 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:01.683559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:01.684049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:01.684471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:01.699365 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] HTTP exception thrown: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Request method failure captured: Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b HTTP/1.1 Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGNIy4AqhLxmh1xyTD74Z6BNMA6Tix6e-vSnc0moMu30e8BCsLlVP6-2ZSJo6ElTSbdcZz-BspaX_ZFoYrWZ2SwM2KNbpw5A8t9rW-VkJqKq0g68yQkFKvbwUSe44FNuflZNVD5AW1mjCydagNdZPaLsVDKcDWbG5tVz3JWj8diwrI Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:22:01.701040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f991d9be87e5494588cafcdcd6841e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f991d9be87e5494588cafcdcd6841e7d"}]}] Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-DeleteServersTestJSON-168619910 Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: f991d9be87e5494588cafcdcd6841e7d Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-DeleteServersTestJSON-168619910 Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: f97d0910139b4610b792092b6133596d Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-DeleteServersTestJSON-168619910-project Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.702261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '03815042-41b5-4e56-a2cc-fa3223abbb2b'} Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:22:01.703069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. Aug 29 19:22:01.704144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:01.705234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] Returning 404 to user: Instance 03815042-41b5-4e56-a2cc-fa3223abbb2b could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:22:01.705234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f3fbf826-93fd-4459-94a1-bf4689612e81 tempest-DeleteServersTestJSON-168619910 tempest-DeleteServersTestJSON-168619910-project] 10.222.0.62 "GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b" status: 404 len: 111 microversion: 2.1 time: 0.033804 Aug 29 19:22:01.705234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 81/173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:01 2022] GET /compute/v2.1/servers/03815042-41b5-4e56-a2cc-fa3223abbb2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:22:02.075153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:02.076121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:02.085335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:02.085830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:02.086265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:02.086973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:02.087428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:02.087987 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:02.368447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:02.384683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2c1cb50b-302d-4bf8-90dd-207190a2591d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.313900 Aug 29 19:22:02.399751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 93/174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:02 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:02.519351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1915081751", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:02.598329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] validate_networks() for None {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:22:03.028257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:22:03.028950 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:22:03.029689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:22:03.030314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:22:03.030722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:22:03.041862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:03.044922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:03.044922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:03.044922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:03.044922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:03.045341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:03.062088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Getting quotas for project c8ca8d208d474d27b9e0b0bda068528e. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:22:03.066398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Getting quotas for user 20ac57d592304654832256db715efdef and project c8ca8d208d474d27b9e0b0bda068528e. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:22:03.077415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:22:03.080536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:22:03.240168 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1239207d-040a-4543-9d5d-4f735df34654 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724431 Aug 29 19:22:03.241115 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 82/175] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:22:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:22:03.252642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f245b295-edd2-4e96-9d62-101616c3b405 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:03.262018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f245b295-edd2-4e96-9d62-101616c3b405 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:03.410109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:03.410729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:03.412557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f245b295-edd2-4e96-9d62-101616c3b405 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:03.424042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:03.424806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:03.425220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f245b295-edd2-4e96-9d62-101616c3b405 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1215 microversion: 2.1 time: 0.174567 Aug 29 19:22:03.425454 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:03.426270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:03.426848 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 94/176] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:03 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:03.427273 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:03.427708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:03.920845 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:03.930621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-70c34f44-6c78-40f8-9c57-0b9d5bf0b1c1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.525094 Aug 29 19:22:03.931402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 83/177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:03 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:04.447125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-692a09dc-95d7-47bf-becb-a2da2762e463 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:04.448281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-692a09dc-95d7-47bf-becb-a2da2762e463 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:04.601374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-692a09dc-95d7-47bf-becb-a2da2762e463 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:04.616450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-692a09dc-95d7-47bf-becb-a2da2762e463 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1215 microversion: 2.1 time: 0.173531 Aug 29 19:22:04.617673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 95/178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:04 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:04.956389 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:04.958039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:04.983022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:04.984158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:04.985129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:04.995831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:04.996632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:04.997262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:05.256560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:05.266057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-60d384aa-ec44-4bc6-af6d-db00e5deac63 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.315850 Aug 29 19:22:05.268228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 84/179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:04 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:05.642546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:05.643239 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:05.662462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:05.662964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:05.663401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:05.669026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:05.669638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:05.670036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:05.760999 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:05.772314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fd667330-2d98-40fe-a1ce-041876ad3fb5 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1211 microversion: 2.1 time: 0.133315 Aug 29 19:22:05.774727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 96/180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:05 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:06.289786 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:06.291307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:06.310175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:06.310861 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:06.311843 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:06.312922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:06.314203 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:06.314888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:06.590529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:06.612964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d8c59ff9-d320-4795-894b-544dbcc3918b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.327741 Aug 29 19:22:06.613850 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 85/181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:06 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:06.797769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:06.799241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:06.810522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:06.812952 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:06.815258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:06.816055 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:06.818604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:06.819138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:06.975529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:06.985871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6f7d43cb-be40-446a-b079-742f2ad1868f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1267 microversion: 2.1 time: 0.192317 Aug 29 19:22:06.987843 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 97/182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:06 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:07.643502 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:07.646185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:07.656143 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:07.656648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:07.657177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:07.657877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:07.658331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:07.659584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:07.898268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:07.915734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5806cae6-eb32-4b4d-b573-88f6a80d069a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.276914 Aug 29 19:22:07.917008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 86/183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:07 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:08.006773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:08.008000 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:08.015311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:08.018071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:08.024027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:08.024983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:08.026034 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:08.026468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:08.099140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:08.108737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ce42e8f9-d9b7-4dff-a5cf-8cfd3d54847c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1273 microversion: 2.1 time: 0.105651 Aug 29 19:22:08.109317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 98/184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:08 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:08.938167 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:08.939671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:08.946979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:08.947467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:08.947980 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:08.959742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:08.959742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:08.959742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:08.970950 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:09.133710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:09.134612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:09.148929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:09.149429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:09.150251 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:09.151519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:09.152181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:09.152647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:09.218329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:09.226246 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a01775d2-6bcc-4bfc-be3d-595ba0c87340 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.292913 Aug 29 19:22:09.227013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 87/185] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:08 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:09.436912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:09.450821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-54256702-4175-4b9a-a8a5-2e00b38514fd tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.319755 Aug 29 19:22:09.450821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 99/186] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:09 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:10.082653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-1de9ea72-2495-4453-8fd2-f25fbf05c01f req-12abe014-6f91-4ea9-8aa2-40ed8cb1bd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed48d5d8-960e-4206-ae61-1c34c509b4f8", "tag": "ce8a2ca3-826a-4411-a6dc-8d7d0ab35996"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:10.097278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1de9ea72-2495-4453-8fd2-f25fbf05c01f req-12abe014-6f91-4ea9-8aa2-40ed8cb1bd79 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:10.098028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1de9ea72-2495-4453-8fd2-f25fbf05c01f req-12abe014-6f91-4ea9-8aa2-40ed8cb1bd79 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:10.099117 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1de9ea72-2495-4453-8fd2-f25fbf05c01f req-12abe014-6f91-4ea9-8aa2-40ed8cb1bd79 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:10.115260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-1de9ea72-2495-4453-8fd2-f25fbf05c01f req-12abe014-6f91-4ea9-8aa2-40ed8cb1bd79 service nova] Creating event network-changed:ce8a2ca3-826a-4411-a6dc-8d7d0ab35996 for instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 on hv-cinder-85501 Aug 29 19:22:10.120930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-1de9ea72-2495-4453-8fd2-f25fbf05c01f req-12abe014-6f91-4ea9-8aa2-40ed8cb1bd79 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042917 Aug 29 19:22:10.122233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 88/187] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:10.247516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:10.248095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:10.254277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:10.254766 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:10.255201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:10.255927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:10.256411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:10.257004 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:10.402824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:10.410957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f5831f37-1bbe-4541-bb7e-37d46abb16ef tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.167501 Aug 29 19:22:10.411925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 100/188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:10 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:10.470784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:10.471576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:10.479432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:10.480128 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:10.480555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:10.481289 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:10.481734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:10.482148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:10.658152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:10.666014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5104ec51-25f4-4f6a-a675-a582b9dd333f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.199462 Aug 29 19:22:10.666581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 89/189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:10 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:11.432835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:11.433461 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:11.440293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:11.440788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:11.441222 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:11.441961 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:11.442444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:11.442866 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:11.578065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:11.586257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7bfc9797-c0d8-49a3-8d22-ac99d8275e30 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.157916 Aug 29 19:22:11.586835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 101/190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:11 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:11.688427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:11.689010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:11.696230 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:11.696710 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:11.697137 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:11.697829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:11.698271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:11.698684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:11.826359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:11.834542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3c837102-481b-4b11-bd73-e5b9390afab0 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.150380 Aug 29 19:22:11.835131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 90/191] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:11 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:12.608305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:12.608922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:12.615942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:12.616428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:12.616857 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:12.617553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:12.618006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:12.618423 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:12.758365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:12.767709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2589d4f5-c729-4501-9df0-c45836ac5d7d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.163397 Aug 29 19:22:12.768631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 102/192] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:12 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:12.858306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:12.859458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:12.866731 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:12.867208 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:12.867650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:12.868466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:12.868935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:12.869355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:13.057452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:13.072928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:13.191085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:13.204663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-dd533aba-3eb7-4b7d-b0ba-6c1ee32e2012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.352203 Aug 29 19:22:13.215186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 91/193] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:12 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:13.790241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:13.792529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:13.801245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:13.802621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:13.803284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:13.804345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:13.805044 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:13.805688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:14.065725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:14.101765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e7d18c6f-4f1d-40a0-9f4f-c313a88fcdaa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.315980 Aug 29 19:22:14.102384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 103/194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:13 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:14.241308 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:14.256373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:14.272814 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:14.273246 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:14.273687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:14.274650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:14.276900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:14.279019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:14.457851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1513666896", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "networks": [{"uuid": "a6ff1eab-7d7c-490a-bd81-d7c9a77339e1"}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:14.517319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:14.535650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f0599e32-d830-48cd-863d-1297a4de6a76 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.307092 Aug 29 19:22:14.536615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 92/195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:14 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:14.546290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] validate_networks() for [('a6ff1eab-7d7c-490a-bd81-d7c9a77339e1', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:22:14.611091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:14.991261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:22:14.991839 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:22:14.992174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:22:14.992579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:22:14.992986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:22:15.003068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:15.003740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:15.004275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:15.005009 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:15.005455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:15.005895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:15.023621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Getting quotas for project 30da6d7509a64c8b904d8220993af210. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:22:15.027755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Getting quotas for user 5d4092e9fbe24b2ca2f9c283cf22b68c and project 30da6d7509a64c8b904d8220993af210. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:22:15.039699 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:22:15.042025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:22:15.131034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:15.131751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:15.143147 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:15.145083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:15.145540 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:15.146565 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:15.147226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:15.147874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:15.299044 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-840f0ec8-4104-4f8f-81e3-6c5aa3cf5b6b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844000 Aug 29 19:22:15.302327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 104/196] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:22:15.313982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bf0cc28a-ef3a-40ff-97ff-e796d4e95069 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:15.317822 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bf0cc28a-ef3a-40ff-97ff-e796d4e95069 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:15.381893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:15.395505 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-17e05b25-6c73-46ca-b698-901acfcfe481 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.269727 Aug 29 19:22:15.401728 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 93/197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:15 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:15.455570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bf0cc28a-ef3a-40ff-97ff-e796d4e95069 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:15.467636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bf0cc28a-ef3a-40ff-97ff-e796d4e95069 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1214 microversion: 2.1 time: 0.159723 Aug 29 19:22:15.483124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 105/198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:15 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:15.561642 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:15.562468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:15.570349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:15.570844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:15.571281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:15.572020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:15.575062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:15.581372 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:15.730028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:15.739191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2acfb48e-667a-4269-bf80-2dfa04c46603 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.183877 Aug 29 19:22:15.740468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 94/199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:15 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:16.420720 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:16.421981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:16.432161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:16.433052 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:16.433652 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:16.435691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:16.435691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:16.436097 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:16.492092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5d1b4329-b92a-4433-bb0a-070ab1d42aed tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:16.492885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5d1b4329-b92a-4433-bb0a-070ab1d42aed tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:16.606687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5d1b4329-b92a-4433-bb0a-070ab1d42aed tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:16.620090 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5d1b4329-b92a-4433-bb0a-070ab1d42aed tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1214 microversion: 2.1 time: 0.131118 Aug 29 19:22:16.620596 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 95/200] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:16 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:16.647007 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:16.656323 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a96a0e0e-6b52-472b-80e7-f4a47ed8de94 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.241648 Aug 29 19:22:16.657425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 106/201] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:16 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:16.761400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:16.762015 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:16.769829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:16.770328 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:16.770766 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:16.771477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:16.771960 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:16.772388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:16.985587 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:16.993855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-35ebc661-a1ab-48bf-9605-dc64147e1c6d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.236196 Aug 29 19:22:16.994443 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 96/202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:16 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:17.648318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:17.654974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:17.673318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:17.674234 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:17.676420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:17.677755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:17.678075 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:17.678883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:17.679511 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:17.680315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:17.697533 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:17.697898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:17.698340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:17.699063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:17.699526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:17.699987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:17.776462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:17.789956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-63382f4c-697b-4c11-8e60-dae9ef38936d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1218 microversion: 2.1 time: 0.145885 Aug 29 19:22:17.790574 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 107/203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:17 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:17.902404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:17.910958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a6c6815f-a68a-4153-8454-ce4ab332526f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1520 microversion: 2.1 time: 0.236322 Aug 29 19:22:17.923892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 97/204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:17 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:17.976136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8c36c288-4f1f-4c56-b784-745ff3adaf69 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: .version_select at 0x7f1fde721790>, body: {"keypair": {"name": "tempest-keypair-1272174628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/58cJFsYBH8v4z1AWfDcdr4n3fnMv9j+Rk4h8w7xlxQ/WnSd6kArcQe+3hAFFmxLNcwAshGp987w5hOna+7ehK66c+/KX92tsZ0GrVso270DeGABe9xQ6BlBYBRfwyw=="}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:18.001509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-8c36c288-4f1f-4c56-b784-745ff3adaf69 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for project 8e73450992ac46049edabd7000d44bde. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:22:18.005580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-8c36c288-4f1f-4c56-b784-745ff3adaf69 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for user 9d7e9a2846cc4ff3b64a8551a7a733a2 and project 8e73450992ac46049edabd7000d44bde. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:22:18.015427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:18.016601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:18.025036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:18.025621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:18.026497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:18.027435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:18.028131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:18.028758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:18.136149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8c36c288-4f1f-4c56-b784-745ff3adaf69 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291157 Aug 29 19:22:18.143368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 108/205] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:22:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:18.188441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:18.206100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d6c2758c-27be-40c1-9b42-4d75ad6da49a tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.194473 Aug 29 19:22:18.208888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 98/206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:18 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:18.810820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:18.811433 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:18.823618 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:18.825639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:18.826103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:18.830533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:18.831033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:18.831466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:18.917903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:18.926166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2c52fc7a-f614-455d-92c4-70e784070ad7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1266 microversion: 2.1 time: 0.119285 Aug 29 19:22:18.933442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:18.934806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:18.940602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 109/207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:18 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:18.960898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:18.961621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:18.962395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:18.963890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:18.964593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:18.965839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.137507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:19.145839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-38a3d93f-734b-417d-b029-51aa606c2396 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1500 microversion: 2.1 time: 0.216609 Aug 29 19:22:19.157361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 99/208] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:18 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1500 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:19.176347 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:19.178385 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:19.185497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.185983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.186609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.187467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.188713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.189296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.228693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:19.229308 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:19.239295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.240077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.240749 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.241664 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.242131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.242613 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.459600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:19.466911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:19.476453 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-84263c30-1bc5-4c42-9cbe-3665c0c7582d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1514 microversion: 2.1 time: 0.303384 Aug 29 19:22:19.479054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-191ce724-47a7-471a-809c-ca69e766bbda tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.254531 Aug 29 19:22:19.479411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 110/209] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:19 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:19.480289 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 100/210] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:19 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:19.541776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-a4349aa2-3bf6-4f71-9768-f33b005aa5b0 req-ffa13902-0dca-4525-9c07-03a76158b204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed48d5d8-960e-4206-ae61-1c34c509b4f8", "name": "network-vif-plugged", "status": "completed", "tag": "ce8a2ca3-826a-4411-a6dc-8d7d0ab35996"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:19.557819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a4349aa2-3bf6-4f71-9768-f33b005aa5b0 req-ffa13902-0dca-4525-9c07-03a76158b204 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.562390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a4349aa2-3bf6-4f71-9768-f33b005aa5b0 req-ffa13902-0dca-4525-9c07-03a76158b204 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.564556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a4349aa2-3bf6-4f71-9768-f33b005aa5b0 req-ffa13902-0dca-4525-9c07-03a76158b204 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.585556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-a4349aa2-3bf6-4f71-9768-f33b005aa5b0 req-ffa13902-0dca-4525-9c07-03a76158b204 service nova] Creating event network-vif-plugged:ce8a2ca3-826a-4411-a6dc-8d7d0ab35996 for instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 on hv-cinder-85501 Aug 29 19:22:19.592921 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-a4349aa2-3bf6-4f71-9768-f33b005aa5b0 req-ffa13902-0dca-4525-9c07-03a76158b204 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055514 Aug 29 19:22:19.598808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 111/211] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:19.956804 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:19.957518 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:19.970765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.975257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.975912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:19.976779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:19.977356 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:19.977878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:20.080694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:20.093942 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bfa16e5d-c4bc-4975-b20a-5d29c553f208 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1274 microversion: 2.1 time: 0.138893 Aug 29 19:22:20.093942 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 101/212] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:19 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:20.511430 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:20.512736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:20.528782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:20.537422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:20.537422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:20.537422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:20.537422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:20.538614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:20.604100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:20.854232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:20.866397 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0354e84a-2f7c-4861-ad96-42df066c7d61 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1315 microversion: 2.1 time: 0.366370 Aug 29 19:22:20.867329 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 112/213] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:20 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:21.115239 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:21.116445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:21.130576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:21.130576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:21.130576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:21.130576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:21.131017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:21.133359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:21.259643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:21.268707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-291a9268-2787-4c5f-89f5-7b59025dde2c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1272 microversion: 2.1 time: 0.157141 Aug 29 19:22:21.282485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 102/214] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:21 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:21.630170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2083841241", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2845fe81-1a73-4dad-93b4-f9edcb5b7a00"}], "security_groups": [{"name": "tempest-securitygroup--1279739432"}], "key_name": "tempest-keypair-1272174628", "user_data": "}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:21.697849 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:21.700477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:21.710403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:21.710403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:21.710960 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:21.712105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:21.712779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:21.713420 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:21.759395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'flavor' on Instance uuid 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:21.869209 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] validate_networks() for [('2845fe81-1a73-4dad-93b4-f9edcb5b7a00', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:22:21.998942 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:22.108662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-404b6887-90db-44dc-a061-4d19f08afb1d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/action" status: 200 len: 32 microversion: 2.1 time: 0.418050 Aug 29 19:22:22.111961 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 103/215] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:22:21 2022] POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/action => generated 32 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:22:22.116277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:22.117660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:22.130409 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:22.130935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:22.131448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:22.132427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:22.133126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:22.134194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:22.498634 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:22.507822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f9765a96-fc7b-47ca-b742-5e6d96a92239 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1464 microversion: 2.1 time: 0.396538 Aug 29 19:22:22.508433 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 104/216] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:22 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1464 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:22.513733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:22.514294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:22.525659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:22.526409 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:22.527019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:22.529382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:22.530620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:22.530620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.215503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:22:23.216995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:22:23.217695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:22:23.218322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:22:23.218942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:22:23.220445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:23.222632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:23.232300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.232768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c7758e19-ae88-4d34-ab3c-67a973ab883f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.721827 Aug 29 19:22:23.233417 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.234089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.235871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.236555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.237317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.239495 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 105/217] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:22 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:23.248339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:23.249618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:23.253365 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:23.259823 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.261996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.262736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for project 8e73450992ac46049edabd7000d44bde. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:22:23.263047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.264572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.265225 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.265929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.268191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for user 9d7e9a2846cc4ff3b64a8551a7a733a2 and project 8e73450992ac46049edabd7000d44bde. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:22:23.280751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:22:23.283611 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:22:23.508629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:23.518037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-01997e15-3fd5-4895-aa61-d10e82d479a0 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.277381 Aug 29 19:22:23.518881 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 106/218] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:23 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:23.524494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:23.526187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:23.532694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.533412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.534028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.534901 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.535923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.536503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.556304 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fe3a720a-dcb1-452d-be15-4531de14c5e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.932633 Aug 29 19:22:23.558224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 113/219] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:22:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:22:23.566893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:22:23.570038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1dbf70bf-8759-4456-90d6-e3873f884870 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:23.571286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1dbf70bf-8759-4456-90d6-e3873f884870 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:23.668563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1dbf70bf-8759-4456-90d6-e3873f884870 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:23.676395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1dbf70bf-8759-4456-90d6-e3873f884870 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1238 microversion: 2.1 time: 0.110196 Aug 29 19:22:23.680121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 114/220] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:23 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:23.923094 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-66ba4596-7e7b-449c-8b38-8ca8a9793c20 req-116ad4e6-4d2b-4e29-ae43-12216f5becd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5083bd37-7582-4408-8d43-6cff24a50dfe", "tag": "708a2d08-fbf5-4f86-a8bf-04316546cf8f"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:23.932650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-66ba4596-7e7b-449c-8b38-8ca8a9793c20 req-116ad4e6-4d2b-4e29-ae43-12216f5becd7 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:23.933128 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-66ba4596-7e7b-449c-8b38-8ca8a9793c20 req-116ad4e6-4d2b-4e29-ae43-12216f5becd7 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:23.933552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-66ba4596-7e7b-449c-8b38-8ca8a9793c20 req-116ad4e6-4d2b-4e29-ae43-12216f5becd7 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:23.944786 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-66ba4596-7e7b-449c-8b38-8ca8a9793c20 req-116ad4e6-4d2b-4e29-ae43-12216f5becd7 service nova] Creating event network-changed:708a2d08-fbf5-4f86-a8bf-04316546cf8f for instance 5083bd37-7582-4408-8d43-6cff24a50dfe on hv-cinder-85501 Aug 29 19:22:23.949776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-66ba4596-7e7b-449c-8b38-8ca8a9793c20 req-116ad4e6-4d2b-4e29-ae43-12216f5becd7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030839 Aug 29 19:22:23.950366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 115/221] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:22:24.035233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1d9587fa-6e2c-446c-a05b-d105f5ed957f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 204 len: 0 microversion: 2.1 time: 0.514804 Aug 29 19:22:24.035818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 107/222] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:22:23 2022] DELETE /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:22:24.045479 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:24.046210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:24.052957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:24.053447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:24.053901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:24.054578 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:24.055080 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:24.055506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:24.200110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:24.206572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5cc1e3b1-c474-4cd8-aa48-d3add0790ce2 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1470 microversion: 2.1 time: 0.165911 Aug 29 19:22:24.207160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 116/223] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:24 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:24.256685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:24.257814 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:24.264392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:24.264955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:24.265613 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:24.266444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:24.267367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:24.267897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:24.411574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:24.419821 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5695fdde-fa26-4a39-897a-4fcec920ddd5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.167273 Aug 29 19:22:24.420416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 108/224] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:24 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:24.539180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:24.539728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:24.545681 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:24.546169 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:24.546592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:24.547302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:24.547774 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:24.548199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:24.686009 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:24.700325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0713a641-5680-41b4-86cd-bdd1f0ae34f7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.165066 Aug 29 19:22:24.700919 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 117/225] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:24 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:24.706313 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4076d87f-ca3c-461e-abca-8af380bd44ab tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:24.706959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4076d87f-ca3c-461e-abca-8af380bd44ab tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:24.778031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4076d87f-ca3c-461e-abca-8af380bd44ab tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:24.795258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4076d87f-ca3c-461e-abca-8af380bd44ab tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1238 microversion: 2.1 time: 0.096939 Aug 29 19:22:24.796141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 109/226] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:24 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:25.231370 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:25.232009 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:25.249630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.250278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.250561 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.251272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.251726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.252172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.401250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:25.409872 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-334ad1ed-e500-4e82-8cd1-96d8a2c0ec1d tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1470 microversion: 2.1 time: 0.182201 Aug 29 19:22:25.410448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 118/227] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:25 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:25.442206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:25.443437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:25.452637 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.453295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.454485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.455543 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.456231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.456863 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.598988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:25.606697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-aff06c7e-8f41-40b6-be3c-8687b42ad093 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.169622 Aug 29 19:22:25.607278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 110/228] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:25 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:25.722277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:25.725371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:25.729501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.729991 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.730418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.731188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.731645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.732094 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.820466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:25.821198 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:25.830350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.830350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.830350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.831069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:25.831515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:25.832157 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:25.894790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:25.903094 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-99d89f36-33d6-47cc-ade9-267a927b9f80 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.185480 Aug 29 19:22:25.903664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 119/229] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:25 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:25.914885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:25.921834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f42a549b-5b8a-446f-af02-7d1f16251156 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1242 microversion: 2.1 time: 0.105712 Aug 29 19:22:25.922469 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 111/230] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:25 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:26.431006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:26.431612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:26.440013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.440013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.440013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.440013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.440348 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.440436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.579954 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:26.588168 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e8eb81a6-3353-41a2-a641-d0464b0db647 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1470 microversion: 2.1 time: 0.161078 Aug 29 19:22:26.588671 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 120/231] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:26 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:26.628893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:26.630144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:26.637254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.637752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.638186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.638892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.639380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.639810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.777566 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:26.785459 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d76af7a3-4fce-4e60-8e1b-267018583ed7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.160852 Aug 29 19:22:26.786035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 112/232] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:26 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:26.925872 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:26.926471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:26.932819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.933312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.933801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.934515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.934990 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.935405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.943383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:26.944088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:26.950512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.950996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.951433 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:26.952175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:26.952665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:26.953075 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:27.039148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:27.045152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ce6c50dd-a696-4fa6-899d-1864308f0237 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1242 microversion: 2.1 time: 0.105673 Aug 29 19:22:27.045727 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 113/233] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:26 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:27.101832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:27.110425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2e4731fa-d44a-4681-acd5-bce79b64d451 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.188429 Aug 29 19:22:27.110993 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 121/234] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:26 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:27.609362 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:27.610294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:27.616308 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:27.616792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:27.617227 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:27.617927 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:27.618380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:27.618803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:27.772193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:27.786983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6b1dbedd-06e1-4313-861a-fc87d82b048b tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1470 microversion: 2.1 time: 0.181399 Aug 29 19:22:27.787840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 114/235] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:27 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:27.807065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:27.807739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:27.818297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:27.818825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:27.819259 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:27.820045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:27.820503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:27.820926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:28.017420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:28.028701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bb67cb19-f004-413d-a4fd-c6e3954dd51d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.225818 Aug 29 19:22:28.029439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 122/236] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:27 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:28.069093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:28.069093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:28.074852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:28.075579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:28.076223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:28.076981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:28.077579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:28.078013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:28.131447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:28.132436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:28.139083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:28.139472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:28.139910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:28.140912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:28.142201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:28.142670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:28.156087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:28.169018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-261f6b88-1078-4228-93a7-fc6eccbece54 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1242 microversion: 2.1 time: 0.104548 Aug 29 19:22:28.170855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 115/237] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:28 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:28.311500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:28.320117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4f648a50-725b-4726-bcaa-f86b46977fd8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.192685 Aug 29 19:22:28.320688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 123/238] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:28 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:28.808554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:28.809151 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:28.816624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:28.817118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:28.817550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:28.818251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:28.818702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:28.819290 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.051488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:29.052953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:29.060557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.061148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.061705 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.062566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.064010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.064548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.195102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:29.208084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0aa41441-9b66-4154-b959-3affa53ed256 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1470 microversion: 2.1 time: 0.403213 Aug 29 19:22:29.209112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 116/239] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:28 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:29.217330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:29.218247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:29.226484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.227282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.227940 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.228737 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.229940 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.231500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.366711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:29.377612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-13f98169-4807-4c7c-b3b9-482c97ad7fe6 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1290 microversion: 2.1 time: 0.166221 Aug 29 19:22:29.378264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 117/240] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:29 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1290 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:29.382725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:29.383392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:29.390597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.391161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.391899 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.392671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.393205 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.393706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.424635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:29.440408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9ae2fdfd-8c8e-4a09-9d12-5fde66a78a98 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.393934 Aug 29 19:22:29.441274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 124/241] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:29 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:29.597408 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:29.605182 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3bba530d-e747-4e76-a965-b50598813588 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.225915 Aug 29 19:22:29.606055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 118/242] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:29 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:29.792207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-70134033-d14a-4e00-a5a4-6fd989ba5716 req-2c51d4d9-6f4b-40ec-9f00-1db6f6c680f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed48d5d8-960e-4206-ae61-1c34c509b4f8", "name": "network-vif-deleted", "tag": "ce8a2ca3-826a-4411-a6dc-8d7d0ab35996"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:29.804189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-70134033-d14a-4e00-a5a4-6fd989ba5716 req-2c51d4d9-6f4b-40ec-9f00-1db6f6c680f9 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:29.804576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-70134033-d14a-4e00-a5a4-6fd989ba5716 req-2c51d4d9-6f4b-40ec-9f00-1db6f6c680f9 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:29.805117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-70134033-d14a-4e00-a5a4-6fd989ba5716 req-2c51d4d9-6f4b-40ec-9f00-1db6f6c680f9 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:29.818713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-70134033-d14a-4e00-a5a4-6fd989ba5716 req-2c51d4d9-6f4b-40ec-9f00-1db6f6c680f9 service nova] Creating event network-vif-deleted:ce8a2ca3-826a-4411-a6dc-8d7d0ab35996 for instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 on hv-cinder-85501 Aug 29 19:22:29.824376 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-70134033-d14a-4e00-a5a4-6fd989ba5716 req-2c51d4d9-6f4b-40ec-9f00-1db6f6c680f9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 Aug 29 19:22:29.825223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 125/243] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:30.229988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:30.230512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:30.239099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.239597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.240101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.240815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.241350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.241781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.309711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:30.313979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:30.318640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d1b424d5-4220-49f1-a3f9-d3c0829bf012 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1428 microversion: 2.1 time: 0.092776 Aug 29 19:22:30.319244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 119/244] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:30 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:30.401892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:30.402585 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:30.409465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.409946 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.410371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.411058 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.411504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.411941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.462763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:30.463376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:30.470318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.470990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.471428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.472188 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.472648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.473078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.476735 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:30.484661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a5d51386-2d5a-4cf5-b431-0be33cc9745f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1298 microversion: 2.1 time: 0.087223 Aug 29 19:22:30.485554 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 126/245] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:30 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:30.609419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:30.617794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ce640620-c538-4c2e-ad86-634b68be9f0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.159132 Aug 29 19:22:30.618374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 120/246] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:30 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:30.626534 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:30.627149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:30.633480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.633966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.634387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.635090 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:30.635606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:30.636064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:30.787743 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:30.795891 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8370b840-7b29-412a-8942-b22357214075 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.173428 Aug 29 19:22:30.796487 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 127/247] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:30 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:31.365136 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:31.365765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:31.373141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.373633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.374072 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.374785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.375441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.375956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.446068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:31.454654 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0cff8360-d2c1-4bd3-98ed-1e88366bd58e tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1428 microversion: 2.1 time: 0.093909 Aug 29 19:22:31.456473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 121/248] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:31 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:31.506222 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:31.506820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:31.513279 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.513776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.514216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.514931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.515394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.516378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.581025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:31.589004 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-45e68cd7-b694-4e1e-8e63-3ba9aac5c2ee tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1298 microversion: 2.1 time: 0.086615 Aug 29 19:22:31.589585 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 128/249] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:31 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:31.639010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:31.639536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:31.647735 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.648251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.648812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.649532 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.649997 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.650569 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.793362 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:31.801517 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cbd0b141-0430-4f52-8d46-58fd5ab727d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.166647 Aug 29 19:22:31.802101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 122/250] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:31 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:31.818239 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:31.818845 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:31.825028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.825744 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.825901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.826583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:31.827032 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:31.827448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:31.963678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:31.974379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fabb043d-328a-4c5b-8dbc-d155860a6b7a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.159471 Aug 29 19:22:31.976133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 129/251] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:31 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:32.062521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:32.064008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:32.070590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.071077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.071535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.072415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.072981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.073454 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.262285 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4542ed3a-8215-4b56-992d-d87cfaefd5bd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/ips" status: 200 len: 151 microversion: 2.20 time: 0.203629 Aug 29 19:22:32.263192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 123/252] 10.222.0.62 () {60 vars in 1289 bytes} [Mon Aug 29 19:22:32 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/ips => generated 151 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:22:32.476372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:32.477050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:32.483128 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.483610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.484068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.485583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.486038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.486452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.551149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:32.559254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8601d5b7-26d7-451b-b1d0-6ea2ea1e28a9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1428 microversion: 2.1 time: 0.086988 Aug 29 19:22:32.559833 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 130/253] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:32 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:32.611867 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:32.612518 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:32.619369 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.619878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.620326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.621068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.621719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.622145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.692247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:32.701652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f6eb91a4-cded-4f78-88f2-575b8f888a0c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1298 microversion: 2.1 time: 0.094642 Aug 29 19:22:32.702229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 124/254] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:32 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:32.822665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:32.823588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:32.831069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.831653 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.832116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.832827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:32.833276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:32.833697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:32.978282 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:32.986972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-94cb6b3c-62e2-4932-a58f-8dde2bce5ffa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.168105 Aug 29 19:22:32.987554 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 131/255] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:32 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:33.000616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:33.001229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:33.007375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:33.007894 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:33.008330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:33.009043 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:33.009490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:33.009907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:33.182021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:33.194636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-58cc1ac9-57b6-400f-af79-c32d9a0de4a9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.196991 Aug 29 19:22:33.195021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 125/256] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:32 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:33.580948 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:33.581863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:33.583969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:33.590343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:33.590846 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:33.591283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:33.592334 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:33.592854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:33.593217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:33.597894 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:33.675514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=20 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:33.714366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:33.723968 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:33.724542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-701d24ce-2507-4f43-8d1c-65175d2a260f tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1428 microversion: 2.1 time: 0.147109 Aug 29 19:22:33.724633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:33.742504 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:33.742836 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 132/257] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:33 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1428 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:33.742938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:33.742938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:33.742938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:33.742938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:33.743254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:33.825463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:33.834326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c4f06273-663e-43f8-b158-65682aec9ea1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1298 microversion: 2.1 time: 0.115293 Aug 29 19:22:33.834908 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 126/258] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:33 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:34.008879 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:34.008879 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:34.015480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.020830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.020830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.020830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.020830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.021196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.202150 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:34.221636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:34.222684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c97bc500-b4e5-49d3-85e0-f0f02eabc7cc tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.218305 Aug 29 19:22:34.241414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 133/259] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:34 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:34.242145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:34.245341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.245840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.247171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.248011 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.248485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.248918 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.502972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:34.511478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7bbe673a-3a26-4ce4-b7e0-3d08dc15fb0b tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.298022 Aug 29 19:22:34.512112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 127/260] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:34 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:34.750602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:34.751289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:34.758959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.759536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.760068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.760866 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.761368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.761995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.795788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.796308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.796772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.797870 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lazy-loading 'fault' on Instance uuid ed48d5d8-960e-4206-ae61-1c34c509b4f8 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:34.856555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:34.857255 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:34.861609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=4 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:34.865576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.866064 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.866496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.867578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:34.868085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:34.868660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:34.912165 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:34.920509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c6f5cd0e-9a84-4c4a-98cd-a17e41517d48 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1305 microversion: 2.1 time: 0.174737 Aug 29 19:22:34.921462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 134/261] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:34 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:34.974148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:34.987020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ecaab00b-5b32-4ebb-9449-87022b190f57 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1296 microversion: 2.1 time: 0.134606 Aug 29 19:22:34.987639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 128/262] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:34 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:35.033958 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:35.034501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:35.042294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.043175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.044037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.044779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.045733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.046207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.076114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lazy-loading 'flavor' on Instance uuid db903f97-8e2a-428c-a4d8-64321853b802 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:35.266597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:35.269458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:35.277440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.278318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.279085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.279948 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.280527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.280965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.436915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:35.446077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-32aeb21b-adc1-4752-91fa-ceb301fc219c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.188986 Aug 29 19:22:35.446706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 129/263] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:35 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:35.534908 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:35.535883 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:35.542578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.543076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.543515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.544295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.544864 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.545321 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.693026 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:35.701423 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-af5751ab-d7a5-4aa7-898a-16b71aabd0f6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.172052 Aug 29 19:22:35.707124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4594011d-33b3-4dcf-8177-df52ef9159a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/action" status: 202 len: 0 microversion: 2.20 time: 0.678146 Aug 29 19:22:35.711531 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 135/264] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 19:22:35 2022] POST /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:22:35.711658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 130/265] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:35 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:35.717140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:35.717844 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:35.725252 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.725735 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.726162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.726854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.727301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.727717 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.861605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:35.870379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:35.871897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:35.873064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4299d094-86ed-4030-b76c-ff290066edf9 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.160333 Aug 29 19:22:35.873618 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 136/266] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:35 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:35.944993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:35.945593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:35.952125 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.952599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.953202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.954329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.954997 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.955653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.989510 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:35.990305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:35.990852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:35.991441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lazy-loading 'fault' on Instance uuid ed48d5d8-960e-4206-ae61-1c34c509b4f8 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:36.012195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:36.013213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:36.019810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.020331 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.021318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.021508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.021964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.022407 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.046645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:36.055416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b83861b9-47e6-46ec-8339-874ff8e7121c tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1305 microversion: 2.1 time: 0.113817 Aug 29 19:22:36.070186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 131/267] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:35 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:36.155728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:36.164446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ac2d35f7-4d0d-4422-bcc8-48fb7e33c6f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.155978 Aug 29 19:22:36.165449 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 137/268] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:36 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:36.469536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:36.470148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:36.476114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.476635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.481063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.481063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.481063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.481063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.611055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:36.618896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-95da167b-7ccc-43af-8d6b-092d3b2f117e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.153629 Aug 29 19:22:36.619460 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 132/269] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:36 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:36.722716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:36.723353 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:36.729293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.729767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.730210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.730873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.731321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.731731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.863753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:36.871594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-47c4ef01-d6dc-4eef-8204-c3aaa396fc8f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.152848 Aug 29 19:22:36.872185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 138/270] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:36 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:36.896513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:36.897120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:36.903247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.903726 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.904192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:36.904891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:36.905339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:36.905764 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.041578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:37.051026 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:37.052602 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:37.056773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fcb4be1e-7100-4455-a7e3-7b90fb5395cf tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.161245 Aug 29 19:22:37.056773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 133/271] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:36 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:37.081707 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:37.082428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:37.088926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.089404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.089830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.090520 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.091033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.091396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.124308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.124824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.125287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.125737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lazy-loading 'fault' on Instance uuid ed48d5d8-960e-4206-ae61-1c34c509b4f8 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:37.168702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ac57d592304654832256db715efdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ca8d208d474d27b9e0b0bda068528e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:37.177837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-331f05b1-c161-4373-a5ea-63d96b3f7eb9 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 200 len: 1305 microversion: 2.1 time: 0.099999 Aug 29 19:22:37.178401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 139/272] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:37 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:37.185842 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:37.186475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:37.192602 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.193322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.193756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.194486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.194936 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.195362 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.330045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:37.337982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8035d653-0065-4494-bd97-b62b9f2f1411 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.155911 Aug 29 19:22:37.338556 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 134/273] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:37 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:37.641702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:37.641881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:37.648579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.649110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.649538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.650236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.650704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.651202 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.805942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:37.814108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-65d0f0a6-58b1-463d-af59-6cd16d37e28e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.177467 Aug 29 19:22:37.814680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 140/274] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:37 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:37.893875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:37.894559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:37.900503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.900981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.901573 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:37.902268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:37.902713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:37.903129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.077411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:38.078066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:38.084692 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.085176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.088891 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.089730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.090209 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.090630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.117832 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:38.128743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f2b3cde5-f3bb-4156-988d-18287227839c tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.239614 Aug 29 19:22:38.129330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 135/275] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:37 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:38.201944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:38.202952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] [instance: ed48d5d8-960e-4206-ae61-1c34c509b4f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:38.212865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.213986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.214874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.216153 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.217109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.218029 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.236800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] HTTP exception thrown: Instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 could not be found. Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Request method failure captured: Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 HTTP/1.1 Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHYFPvalPorbfpjEJfDQHCX8dzxVMd9ZM6HqDaSaISvJxRuMhu98SwQmaglH76s_fu2uLfnGHcY8RxAbtIE2CA7M_ND89-hKkBEVOCvQkHD9WPMVPX_IdpBxE0gT2yIukPh1jiSpUWnOmApapJbi4N_nClINRbA3OvLDjC2dbsnc0o Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: c8ca8d208d474d27b9e0b0bda068528e Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-VolumesNegativeTest-1784957545 Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:22:38.253952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8ca8d208d474d27b9e0b0bda068528e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c8ca8d208d474d27b9e0b0bda068528e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c8ca8d208d474d27b9e0b0bda068528e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c8ca8d208d474d27b9e0b0bda068528e"}]}] Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-VolumesNegativeTest-1784957545 Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: c8ca8d208d474d27b9e0b0bda068528e Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-VolumesNegativeTest-1784957545 Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-VolumesNegativeTest-1784957545-project Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 20ac57d592304654832256db715efdef Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-VolumesNegativeTest-1784957545-project Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 could not be found. Aug 29 19:22:38.257570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'ed48d5d8-960e-4206-ae61-1c34c509b4f8'} Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 could not be found. Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:22:38.258542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 could not be found. Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 could not be found. Aug 29 19:22:38.260458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:38.262874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] Returning 404 to user: Instance ed48d5d8-960e-4206-ae61-1c34c509b4f8 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:22:38.262874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f6d2f8cb-46a8-4c0f-a3d6-6c76bda07169 tempest-VolumesNegativeTest-1784957545 tempest-VolumesNegativeTest-1784957545-project] 10.222.0.62 "GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8" status: 404 len: 111 microversion: 2.1 time: 0.045063 Aug 29 19:22:38.262874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 136/276] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:38 2022] GET /compute/v2.1/servers/ed48d5d8-960e-4206-ae61-1c34c509b4f8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:22:38.262874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-fbb2f24e-71eb-4d06-92c8-83f4165c32f8 req-1798554f-9274-4f22-a013-368215e80d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d4166d-63f1-49f0-a7ce-487fb9ce176a", "tag": "938c532b-1c36-4def-86e8-008b64f5cbf6"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:38.263537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-fbb2f24e-71eb-4d06-92c8-83f4165c32f8 req-1798554f-9274-4f22-a013-368215e80d08 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.263537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-fbb2f24e-71eb-4d06-92c8-83f4165c32f8 req-1798554f-9274-4f22-a013-368215e80d08 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.263537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-fbb2f24e-71eb-4d06-92c8-83f4165c32f8 req-1798554f-9274-4f22-a013-368215e80d08 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.268619 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:38.275925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-fbb2f24e-71eb-4d06-92c8-83f4165c32f8 req-1798554f-9274-4f22-a013-368215e80d08 service nova] Creating event network-changed:938c532b-1c36-4def-86e8-008b64f5cbf6 for instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a on hv-cinder-85501 Aug 29 19:22:38.281490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-fbb2f24e-71eb-4d06-92c8-83f4165c32f8 req-1798554f-9274-4f22-a013-368215e80d08 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034190 Aug 29 19:22:38.283192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 137/277] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:38.348521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:38.357519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:38.358962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:38.361791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ed7eec7e-6c32-4060-88fe-0acbe288d083 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.287640 Aug 29 19:22:38.361791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 141/278] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:38 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:38.362030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:38.362652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:38.369734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.370232 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.370662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.371410 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.371903 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.372316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.515633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:38.524095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-66acecd9-8dff-49b2-8b49-29824bf6c7e0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.167703 Aug 29 19:22:38.524762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 138/279] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:38 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:38.835206 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:38.835945 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:38.842599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.843088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.844324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.845028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:38.845481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:38.845900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:38.988224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:38.999133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-212e01d3-eb6a-454e-8cb0-436b8858ef60 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.167674 Aug 29 19:22:39.000420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 142/280] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:38 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:39.150145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:39.150756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:39.157686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:39.158181 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:39.158616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:39.159324 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:39.159780 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:39.160577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:39.304697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:39.312649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d2236a32-63a6-4fe6-8cdc-9697fa46e887 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.166337 Aug 29 19:22:39.313220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 139/281] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:39 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:39.385622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:39.386275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:39.392429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:39.393010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:39.393350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:39.394057 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:39.394512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:39.394943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:39.534484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:39.543576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:39.545243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:39.546437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a0f21435-7335-4de7-bd00-d31366cb14cb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.165867 Aug 29 19:22:39.546725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:39.547442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 143/282] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:39 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:39.550631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:39.558720 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:39.559280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:39.559790 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:39.560615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:39.563261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:39.566370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:39.716449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:39.726115 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1617fe1e-9da0-4ef8-8d83-26b0bfd0f603 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.183687 Aug 29 19:22:39.726713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 140/283] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:39 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:40.022322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:40.022945 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:40.029470 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.030003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.030480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.031346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.031812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.032275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.175278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:40.183400 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-89e29568-066f-4f03-93cb-a4f438043606 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.165406 Aug 29 19:22:40.184008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 144/284] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:40 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:40.334144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:40.334779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:40.341259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.341755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.342190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.342894 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.343371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.343800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.489044 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:40.497144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c4d1ed09-8669-4aed-89d7-16d9d13e6587 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.166753 Aug 29 19:22:40.497645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 141/285] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:40 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:40.570908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:40.571348 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:40.578057 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.578543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.578977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.579695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.580188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.580613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.720564 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:40.730750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:40.732432 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:40.733583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5be8cfca-5f73-4a53-a1fd-2a7b55ba3b8c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.167006 Aug 29 19:22:40.734790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 145/286] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:40 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:40.752729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:40.752729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:40.755468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.756708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.757408 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.758541 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:40.759002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:40.759431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:40.929865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:40.937983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f0493af9-27fc-42b2-8d52-2f51c4861ed3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.193429 Aug 29 19:22:40.938555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 142/287] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:40 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:41.205294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:41.206029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:41.212566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.213068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.213550 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.214253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.214710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.215133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.220522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:41.452486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:41.461523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-04eb2ce5-c8bc-4370-a78f-3e05346f03bb tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.260475 Aug 29 19:22:41.476406 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 146/288] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:41 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:41.523052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:41.524343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:41.531047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.531717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.532388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.533428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.534405 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.535123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.742527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-49843463-6f4f-415a-b544-be8e2357c67e req-68775d43-0152-4186-92c6-84bfc2b2b879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5083bd37-7582-4408-8d43-6cff24a50dfe", "name": "network-vif-plugged", "status": "completed", "tag": "708a2d08-fbf5-4f86-a8bf-04316546cf8f"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:41.758784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-49843463-6f4f-415a-b544-be8e2357c67e req-68775d43-0152-4186-92c6-84bfc2b2b879 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.759360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-49843463-6f4f-415a-b544-be8e2357c67e req-68775d43-0152-4186-92c6-84bfc2b2b879 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.760080 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-49843463-6f4f-415a-b544-be8e2357c67e req-68775d43-0152-4186-92c6-84bfc2b2b879 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.776704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-49843463-6f4f-415a-b544-be8e2357c67e req-68775d43-0152-4186-92c6-84bfc2b2b879 service nova] Creating event network-vif-plugged:708a2d08-fbf5-4f86-a8bf-04316546cf8f for instance 5083bd37-7582-4408-8d43-6cff24a50dfe on hv-cinder-85501 Aug 29 19:22:41.783033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:41.784084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-49843463-6f4f-415a-b544-be8e2357c67e req-68775d43-0152-4186-92c6-84bfc2b2b879 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048063 Aug 29 19:22:41.785436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 147/289] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:41.792094 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8028303c-6d59-464f-8de0-00314ca51dd9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.276896 Aug 29 19:22:41.792466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:41.803975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:41.803975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.803975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.803975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.804898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.804898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.805326 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.808937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 143/290] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:41 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:41.958493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:41.960523 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:41.968171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.968724 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.970660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.971834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:41.972808 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:41.973419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:41.973604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:41.984596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:41.986607 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:41.988024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c2541c8a-ee41-4a7a-96e2-5bf53bcc69c5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.201190 Aug 29 19:22:41.988580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 148/291] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:41 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:42.127900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:42.136727 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d06aa058-cd04-4d04-9ef1-68f4f968ab2a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.181932 Aug 29 19:22:42.137320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 144/292] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:41 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:42.483430 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:42.484205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:42.491671 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:42.492290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:42.492831 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:42.493613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:42.494279 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:42.494801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:42.653062 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:42.663578 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c23bbe0f-baf6-4dfc-9fc2-bc875cd01d86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.184528 Aug 29 19:22:42.664193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 149/293] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:42 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:42.824752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:42.824752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:42.825616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:42.826109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:42.826549 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:42.827258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:42.828179 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:42.828655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.003803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:43.014267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:43.014267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:43.016829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-324ac80f-edcb-406b-abe9-63eee1b6fc41 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.203292 Aug 29 19:22:43.018414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 145/294] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:42 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:43.033344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:43.033882 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:43.034484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.035679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:43.036697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:43.037620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.161769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:43.162745 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:43.170855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:43.171595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:43.172575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.173295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:43.173808 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:43.174273 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.247795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:43.263817 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:43.263817 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:43.264628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-103c9350-015f-4933-b974-409defd4823f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.255369 Aug 29 19:22:43.265476 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 150/295] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:43 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:43.400605 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:43.423973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f3f09179-2647-47b9-895f-4fbfeedf8bb2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.268781 Aug 29 19:22:43.424612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 146/296] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:43 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:43.685081 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:43.689533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:43.693276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:43.693811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:43.694267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.695019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:43.695503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:43.696006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:43.831225 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:43.839093 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-dc9266ef-3b83-401b-b018-803c1d2ed074 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.158320 Aug 29 19:22:43.839659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 151/297] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:43 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:44.037943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:44.038646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:44.047414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.047921 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.048353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.049463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.049828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.050164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.249201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:44.258042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-85ed037e-0407-48ae-9eec-e42787fee03e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1314 microversion: 2.1 time: 0.223861 Aug 29 19:22:44.258672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 147/298] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:44 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:44.288271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:44.289256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:44.295312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.295787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.296245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.297449 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.297898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.298315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.445237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:44.446251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:44.452602 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.457342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.457342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.457342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.457342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.457652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.467765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:44.476422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:44.477874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:44.479352 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bbba6a5a-0de9-4b29-bbfd-70b860eb240e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.194946 Aug 29 19:22:44.479920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 152/299] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:44 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:44.605872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:44.620335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2eadebb8-5d81-4eb6-ba0a-a9b84a9fdee7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.174006 Aug 29 19:22:44.620335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 148/300] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:44 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:44.860276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:44.860959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:44.867039 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.867605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.868123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:44.868855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:44.869340 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:44.869760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.091789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:45.102150 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-af7f1ad2-edda-4738-9177-efc0dee25319 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.246087 Aug 29 19:22:45.102924 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 153/301] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:44 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:45.279009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:45.279685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:45.286795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:45.287276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:45.287713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.288432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:45.288886 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:45.289311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.423760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:45.431513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0001a94b-1bce-4ccc-a7c9-f19c52e43442 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1498 microversion: 2.1 time: 0.156475 Aug 29 19:22:45.432175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 149/302] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:45 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:45.502557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:45.503141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:45.505129 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:45.509786 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:45.510263 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:45.510689 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.511378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:45.511828 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:45.740477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.740996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:45.740996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:45.740996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:45.740996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:45.741610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.741610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:45.741610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:45.741610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:45.742135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:45.742135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:45.742311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:45.742311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6d59a945-2bf1-49f8-90e3-bf3e3650878d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.162101 Aug 29 19:22:45.742311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 154/303] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:45 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:45.777274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:45.785970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-705c53ce-746c-441e-9340-9c874f8c8839 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.153408 Aug 29 19:22:45.786531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 150/304] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:45 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:46.124087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:46.124708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:46.130574 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:46.131051 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:46.131481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:46.132200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:46.133111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:46.133111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:46.273832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:46.281949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3025a74a-bac2-4c90-a3b2-3675f93978b2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.161735 Aug 29 19:22:46.282514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 155/305] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:46 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:46.684219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:46.684853 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:46.687380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:46.692133 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:46.692635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:46.693049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:46.693742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:46.694192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:46.694638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:46.808481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:46.814992 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:46.822911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:46.823743 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:46.824402 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:46.825484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:46.826571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:46.827694 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:46.836327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:46.847235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:46.848647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:46.851276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-376521bb-574c-4949-8a70-336102034e80 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.171811 Aug 29 19:22:46.852122 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 151/306] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:46 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:46.974445 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:46.983020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a159d16c-7a9b-4d18-9c34-bab4d4057915 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.179149 Aug 29 19:22:46.983580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 156/307] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:46 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:47.302998 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:47.303636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:47.310388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.314234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.314234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.314234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.314234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.314615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.459826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:47.476349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cd43253b-42fa-427f-8877-4cfb330a57f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.170384 Aug 29 19:22:47.476349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 152/308] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:47 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:47.487794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:47.488328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:47.497142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.497777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.498267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.498975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.499614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.500067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.528443 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:22:47.877581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:47.879323 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:47.891198 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.892107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.892885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.894286 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.895186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.896240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.904490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-78f78558-1a40-452d-a2a9-57add29e5621 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 204 len: 0 microversion: 2.1 time: 0.419531 Aug 29 19:22:47.907296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 157/309] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:22:47 2022] DELETE /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:22:47.916492 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-e2e91f68-1c62-40dd-b695-b097fba0ac47 req-c4c6b41a-f9cf-48b7-9090-eed93b44c291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d4166d-63f1-49f0-a7ce-487fb9ce176a", "name": "network-vif-plugged", "status": "completed", "tag": "938c532b-1c36-4def-86e8-008b64f5cbf6"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:47.932918 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e2e91f68-1c62-40dd-b695-b097fba0ac47 req-c4c6b41a-f9cf-48b7-9090-eed93b44c291 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.936378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e2e91f68-1c62-40dd-b695-b097fba0ac47 req-c4c6b41a-f9cf-48b7-9090-eed93b44c291 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.936378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e2e91f68-1c62-40dd-b695-b097fba0ac47 req-c4c6b41a-f9cf-48b7-9090-eed93b44c291 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.954512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-e2e91f68-1c62-40dd-b695-b097fba0ac47 req-c4c6b41a-f9cf-48b7-9090-eed93b44c291 service nova] Creating event network-vif-plugged:938c532b-1c36-4def-86e8-008b64f5cbf6 for instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a on hv-cinder-85501 Aug 29 19:22:47.961455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-e2e91f68-1c62-40dd-b695-b097fba0ac47 req-c4c6b41a-f9cf-48b7-9090-eed93b44c291 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052213 Aug 29 19:22:47.965335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 158/310] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:47.967583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:47.969908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:47.977045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.977856 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.978296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:47.979001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:47.979809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:47.986816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:48.168303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:48.179229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:48.186266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:48.186266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c02a7d65-f852-417e-8878-bc4de7ec3710 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.311020 Aug 29 19:22:48.186266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 153/311] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:47 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:48.192386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:48.193237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:48.198925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:48.201109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:48.201898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:48.203125 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:48.203934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:48.205024 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:48.205711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:48.212706 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8dfbf57b-71d9-4628-9d8e-939cc7134b9f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1504 microversion: 2.1 time: 0.249537 Aug 29 19:22:48.226190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 159/312] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:47 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:48.227102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:48.349875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:48.357913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-68e1cdd5-d441-4d09-b9e1-6ca60ad74739 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.172547 Aug 29 19:22:48.358558 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 154/313] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:48 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:48.490724 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:48.491355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:48.497577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:48.498065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:48.498497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:48.499267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:48.500305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:48.500725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:48.638099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:48.646132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6cf50dea-cf81-4dac-ac89-056969495de6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.159536 Aug 29 19:22:48.658042 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 160/314] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:48 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:49.210601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:49.211373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:49.218591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.219069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.219509 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.220264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.220698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.221119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.234060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:49.234673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:49.241258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.241747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.242181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.242953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.243503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.243953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.381031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:49.390461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:49.391944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:49.393135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c1626e00-a7f3-460f-99d3-d136f48dcc06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.187139 Aug 29 19:22:49.393694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 155/315] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:49 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:22:49.406364 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:49.406979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:49.414028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.414528 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.414964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.415667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.416155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.416583 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.599609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:49.603652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:49.609706 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ea4d2e89-e43c-4a7c-8e60-2cf04c9b05be tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1504 microversion: 2.1 time: 0.379742 Aug 29 19:22:49.610516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 161/316] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:49 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:49.615492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bf603fd9-0ef7-4a96-896b-d75feccfa933 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.214871 Aug 29 19:22:49.616083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 156/317] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:49 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:49.666792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:49.667404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:49.673799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.674284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.674716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.675409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:49.675881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:49.676333 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:49.694411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:49.808498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:49.816206 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f0fe62f8-1bda-4cb8-bbdc-68a83fd856d6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.153153 Aug 29 19:22:49.816768 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 162/318] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:49 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:50.416403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:50.416984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:50.423088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.429163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.429163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.429163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.429163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.429510 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.593138 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:50.601816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:50.603356 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:50.604748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-451efe1b-2eb0-4a7a-ae1b-d660567b2142 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.192309 Aug 29 19:22:50.605345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 157/319] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:50 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:50.631244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:50.631954 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:50.638901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.639396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.639964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.641208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.641658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.642077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.646620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:50.649114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:50.656383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.656956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.657402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.658827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.659297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.659729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.850449 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:50.855829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:50.859115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1dca02b1-8f60-4095-ae8a-d3efdf682eb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1504 microversion: 2.1 time: 0.230905 Aug 29 19:22:50.860371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 163/320] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:50 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:50.865432 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:50.865970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2dbfd98a-23e6-4c65-93aa-89e60460423d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.224832 Aug 29 19:22:50.866615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:50.873253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.874022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.875102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 158/321] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:50 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:50.875642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:50.876382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:50.876842 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:50.884627 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:51.040147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:51.049011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-55b4e5a0-2d80-4967-b38c-55fda5d2a8e2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.187264 Aug 29 19:22:51.049567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 164/322] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:50 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:51.629371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:51.630855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:51.637197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:51.637677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:51.638098 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:51.639008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:51.639671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:51.640363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:51.791591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:51.811062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:51.811062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:51.811062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d56d865f-e9bc-4e14-92e2-2bb767b00b81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.180830 Aug 29 19:22:51.812831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 159/323] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:51 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:51.882139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:51.882731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:51.887051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:51.887656 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:51.889164 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:51.889689 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:51.890184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:51.890909 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:51.891350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:51.891767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:51.894265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:51.894265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:51.894671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:51.895370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:51.895828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:51.896282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:52.230000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:52.234395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:52.244549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a99cfd25-3550-4dd2-b42d-53ca7ec0cd2d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1504 microversion: 2.1 time: 0.366670 Aug 29 19:22:52.250388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-98bedde8-2c36-422a-b255-d0817fe4b297 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.367006 Aug 29 19:22:52.264539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 160/324] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:51 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:52.264539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:52.264973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 165/325] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:51 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:52.265561 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:52.289491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:52.295067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:52.295067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:52.295067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:52.295067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:52.295408 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:52.718993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:52.731669 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1ee9bed8-c0ce-4e6a-84a4-1a0b2a05eea0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.479607 Aug 29 19:22:52.732741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 161/326] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:52 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:52.837964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:52.837964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:52.841165 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:52.841767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:52.842283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:52.843378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:52.843881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:52.844538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.031442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:53.039740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:53.041193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:53.042336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-386d7463-d5ae-4034-ba7f-ee8ec4c54996 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.212781 Aug 29 19:22:53.042877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 166/327] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:52 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:53.272101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:53.272713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:53.279233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.280483 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.281577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.282528 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.283260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.283845 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.288046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:53.288715 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:53.299184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.299728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.300694 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.302349 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.303394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.304213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.408925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:53.417115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3afa6b90-fcd0-44d6-bf44-f0ad01cb7dfe tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1462 microversion: 2.1 time: 0.133069 Aug 29 19:22:53.417677 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 167/328] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:53 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1462 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:53.423529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-f787e9c4-fe88-4378-b5a3-d880aeec0f9c req-47a8b561-f873-4d30-80ac-f3a650d5597a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5083bd37-7582-4408-8d43-6cff24a50dfe", "name": "network-vif-deleted", "tag": "708a2d08-fbf5-4f86-a8bf-04316546cf8f"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:53.436017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f787e9c4-fe88-4378-b5a3-d880aeec0f9c req-47a8b561-f873-4d30-80ac-f3a650d5597a service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.436524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f787e9c4-fe88-4378-b5a3-d880aeec0f9c req-47a8b561-f873-4d30-80ac-f3a650d5597a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.437525 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f787e9c4-fe88-4378-b5a3-d880aeec0f9c req-47a8b561-f873-4d30-80ac-f3a650d5597a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.449858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-f787e9c4-fe88-4378-b5a3-d880aeec0f9c req-47a8b561-f873-4d30-80ac-f3a650d5597a service nova] Creating event network-vif-deleted:708a2d08-fbf5-4f86-a8bf-04316546cf8f for instance 5083bd37-7582-4408-8d43-6cff24a50dfe on hv-cinder-85501 Aug 29 19:22:53.455052 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-f787e9c4-fe88-4378-b5a3-d880aeec0f9c req-47a8b561-f873-4d30-80ac-f3a650d5597a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036027 Aug 29 19:22:53.455634 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 168/329] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:53.471110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:53.479309 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a739cb26-0415-4a8d-92ea-70080de72a88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1364 microversion: 2.1 time: 0.211249 Aug 29 19:22:53.485723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 162/330] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:53 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:53.755126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:53.757403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:53.763239 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.763913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.764348 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.765611 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.766061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.766477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.901717 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:53.910878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-191165ba-a19b-449c-8424-9c6db833dda9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1500 microversion: 2.1 time: 0.159894 Aug 29 19:22:53.915520 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 169/331] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:53 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:53.932336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fbe7b4b-2ab2-439d-982e-85c47deae229"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:53.934755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:53.941177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.941650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.942073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.942938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:53.943383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:53.944051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:53.981851 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] HTTP exception thrown: Cannot 'attach_volume' instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca while it is in vm_state rescued Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Request method failure captured: Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/os-volume_attachments HTTP/1.1 Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 74 Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGS7CeGZR4ahpSfByWIi7V0_wyW0sqlGbLKlWF5vh5AJwoiDEtOq5ubLUNqY19BiRcPpHzC6vqtLPi4PwMLsDB1Ioag7GifYTvppdhAFzucgg0mexKP_jbzVEfLmM0Tn5sBkW53pxMlGw35Y4z2-pccig1PgZWE4ogttXsGlxTGhPA Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:22:53.986314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fec9a23227784d23ba703719c785e413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fec9a23227784d23ba703719c785e413"}]}] Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: bd993c0493d447cb9b02e424a28e24bc Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {"volumeAttachment": {"volumeId": "0fbe7b4b-2ab2-439d-982e-85c47deae229"}} Aug 29 19:22:53.987742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Cannot 'attach_volume' instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca while it is in vm_state rescued Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'server_id': '9f63a8f7-75a2-42ee-9699-a63c55b8c3ca', 'body': {'volumeAttachment': {'volumeId': '0fbe7b4b-2ab2-439d-982e-85c47deae229'}}} Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:22:53.988492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca while it is in vm_state rescued Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:53.995885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca while it is in vm_state rescued Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Returning 409 to user: Cannot 'attach_volume' instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca while it is in vm_state rescued {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-edd7b58b-854d-482f-a9bd-2f69809d4f79 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056895 Aug 29 19:22:53.998377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 163/332] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:22:53 2022] POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 19:22:54.000028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:54.000028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:54.003509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.004046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.004481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.005186 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.005639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.006060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.065154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:54.066080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:54.074260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.074260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.074260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.074260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.074752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.074844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.234584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:54.244170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:54.245668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:54.246902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5fb0e49b-5654-4ac5-88dc-0cac1422e07b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.185643 Aug 29 19:22:54.247610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 164/333] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:54 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:54.329339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-247eab5a-5323-4959-a0c2-d118025616c0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/action" status: 202 len: 0 microversion: 2.1 time: 0.338421 Aug 29 19:22:54.329995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 170/334] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:22:53 2022] POST /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:22:54.337976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:54.338571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:54.344451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.344929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.345358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.346038 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.346482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.346900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.439732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:54.440477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:54.453921 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.454426 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.454864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.455608 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.456090 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.456513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.491374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.491878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.492326 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.492775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lazy-loading 'fault' on Instance uuid 5083bd37-7582-4408-8d43-6cff24a50dfe {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:54.501843 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:54.509073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ef9ef23f-3983-4ba9-89cb-1d14458f0921 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1508 microversion: 2.1 time: 0.174723 Aug 29 19:22:54.509715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 165/335] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:54 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:54.516179 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:54.517160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:54.524503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.524994 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.525430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.526386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.526831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.527431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.542364 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:54.554142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-505b44bb-181a-41f5-98ed-524a62e43a63 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1304 microversion: 2.1 time: 0.119158 Aug 29 19:22:54.554720 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 171/336] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:54 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:54.689711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:54.695585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-22ba30e1-c34f-496f-9dd8-66a24c021e0a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1550 microversion: 2.1 time: 0.184845 Aug 29 19:22:54.696187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 166/337] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:54 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:54.715737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:54.716288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:54.722104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.723219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.723219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.723680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:54.724196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:54.724619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:54.806186 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-389412f0-1821-43d5-950e-e1b361f297b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094226 Aug 29 19:22:54.814244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 172/338] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:22:54 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:55.271531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:55.272176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:55.278748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.279252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.279672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.280422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.280935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.281361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.531742 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:55.532228 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:55.538239 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.538672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.539100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.539878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.540335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.540756 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.735661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:55.744633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:55.746865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:55.748097 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2bf9d65f-ecbc-4413-9a6b-d8649c266ca8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1743 microversion: 2.20 time: 0.480630 Aug 29 19:22:55.748658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 167/339] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:55 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1743 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:55.754096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:55.754697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:55.760947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.761427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.761856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.762556 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.763001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.763591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.795717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:55.796466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:55.796742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:55.797185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lazy-loading 'fault' on Instance uuid 5083bd37-7582-4408-8d43-6cff24a50dfe {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:22:55.887804 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:55.899789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8365c158-59b4-4b8f-9821-7e5d11d637cc tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 200 len: 1304 microversion: 2.1 time: 0.149564 Aug 29 19:22:55.903553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:55.915922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 168/340] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:55 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:55.916086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-73409747-a18f-4275-a929-766f71d29721 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1508 microversion: 2.1 time: 0.388286 Aug 29 19:22:55.916320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 173/341] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:55 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:56.369615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-23a1a2c8-a026-427c-b4e0-f42f37346a5e req-ee02db6a-ccfb-4106-9bd5-b91d999e5f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d4166d-63f1-49f0-a7ce-487fb9ce176a", "tag": "938c532b-1c36-4def-86e8-008b64f5cbf6"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:56.380586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-23a1a2c8-a026-427c-b4e0-f42f37346a5e req-ee02db6a-ccfb-4106-9bd5-b91d999e5f6b service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.381061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-23a1a2c8-a026-427c-b4e0-f42f37346a5e req-ee02db6a-ccfb-4106-9bd5-b91d999e5f6b service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.381487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-23a1a2c8-a026-427c-b4e0-f42f37346a5e req-ee02db6a-ccfb-4106-9bd5-b91d999e5f6b service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:56.396296 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-23a1a2c8-a026-427c-b4e0-f42f37346a5e req-ee02db6a-ccfb-4106-9bd5-b91d999e5f6b service nova] Creating event network-changed:938c532b-1c36-4def-86e8-008b64f5cbf6 for instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a on hv-cinder-85501 Aug 29 19:22:56.401822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-23a1a2c8-a026-427c-b4e0-f42f37346a5e req-ee02db6a-ccfb-4106-9bd5-b91d999e5f6b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035754 Aug 29 19:22:56.402516 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 169/342] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:22:56.783011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:56.783011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:56.783011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.783791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.784068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:56.784839 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.785554 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.786047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:56.927438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:56.928034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: 5083bd37-7582-4408-8d43-6cff24a50dfe] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:56.937047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.937534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.937965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:56.938733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.939186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.939763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:56.945685 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:56.955268 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:56.957983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:56.959299 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c92ef743-4f32-4579-8d6e-e4d55aeba951 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1743 microversion: 2.20 time: 0.188838 Aug 29 19:22:56.962183 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] HTTP exception thrown: Instance 5083bd37-7582-4408-8d43-6cff24a50dfe could not be found. Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Request method failure captured: Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe HTTP/1.1 Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHhBqi_CZwg8rMuoguFB2opeLJ8_8z6u2XfhcJblNkDVDUx-w3MW7qDNMp_SFVEE8pWq0qMQmCWnHploSmqaHL5Hk-KyQwWbQfLK-zcb7QdmvE5ULwCuulNRg00fqx2X9suTw7V0ZhLd603AYK_72GjPY32ky2CRuIB-jhbuUSj2fw Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 30da6d7509a64c8b904d8220993af210 Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-VolumesActionsTest-446682927 Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:22:56.963827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30da6d7509a64c8b904d8220993af210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30da6d7509a64c8b904d8220993af210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30da6d7509a64c8b904d8220993af210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30da6d7509a64c8b904d8220993af210"}]}] Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-VolumesActionsTest-446682927 Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 30da6d7509a64c8b904d8220993af210 Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-VolumesActionsTest-446682927 Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-VolumesActionsTest-446682927-project Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 5d4092e9fbe24b2ca2f9c283cf22b68c Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-VolumesActionsTest-446682927-project Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 5083bd37-7582-4408-8d43-6cff24a50dfe could not be found. Aug 29 19:22:56.965458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '5083bd37-7582-4408-8d43-6cff24a50dfe'} Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5083bd37-7582-4408-8d43-6cff24a50dfe could not be found. Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:22:56.966216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5083bd37-7582-4408-8d43-6cff24a50dfe could not be found. Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5083bd37-7582-4408-8d43-6cff24a50dfe could not be found. Aug 29 19:22:56.970195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:22:56.971210 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Returning 404 to user: Instance 5083bd37-7582-4408-8d43-6cff24a50dfe could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:22:56.971210 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-40157bdd-4a1a-4b76-80f1-da229d041131 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe" status: 404 len: 111 microversion: 2.1 time: 0.044609 Aug 29 19:22:56.971352 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 174/343] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:56 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1743 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:56.978072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:56.978692 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:56.987183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.987687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.988145 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:56.988854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:56.989304 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:56.989851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:57.001241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 170/344] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:56 2022] GET /compute/v2.1/servers/5083bd37-7582-4408-8d43-6cff24a50dfe => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:22:57.108744 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-720172676", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "networks": [{"uuid": "a6ff1eab-7d7c-490a-bd81-d7c9a77339e1"}]}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:57.162838 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:57.172320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a8ae5dc8-98e8-4265-baed-5169c232bb14 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1508 microversion: 2.1 time: 0.200821 Aug 29 19:22:57.176818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 175/345] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:56 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:57.196798 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] validate_networks() for [('a6ff1eab-7d7c-490a-bd81-d7c9a77339e1', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:22:57.984529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:57.985395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:57.992965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:57.993830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:57.994569 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:57.995523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:57.996242 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:57.996897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:58.068805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:22:58.070858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:22:58.070858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:22:58.071306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:22:58.071733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:22:58.082965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:58.083644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:58.084592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:58.085490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:58.086134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:58.086733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:58.130279 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Getting quotas for project 30da6d7509a64c8b904d8220993af210. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:22:58.135597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Getting quotas for user 5d4092e9fbe24b2ca2f9c283cf22b68c and project 30da6d7509a64c8b904d8220993af210. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:22:58.154464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:22:58.156916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:22:58.227542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:58.237110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:58.238538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:58.239687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fc1c79f6-f87e-48c3-95e1-8c9277cdd860 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1743 microversion: 2.20 time: 0.260044 Aug 29 19:22:58.240407 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 176/346] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:57 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:58.245190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:58.245798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:58.253337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:58.254536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:58.263829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:58.263829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:58.263829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:58.263829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:58.403500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3877470a-93f8-4ed4-a15e-f9830e2f7a15 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.290527 Aug 29 19:22:58.403500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 171/347] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:22:58.406154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-318d75e8-31c4-4589-bd25-d5148c1ab98d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:58.406773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-318d75e8-31c4-4589-bd25-d5148c1ab98d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:58.457728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:58.466384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5944df89-78fb-4829-8667-335beeff476e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1508 microversion: 2.1 time: 0.224923 Aug 29 19:22:58.470011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 177/348] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:58 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:58.473777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-318d75e8-31c4-4589-bd25-d5148c1ab98d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:58.482265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-318d75e8-31c4-4589-bd25-d5148c1ab98d tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1213 microversion: 2.1 time: 0.079901 Aug 29 19:22:58.482831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 172/349] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:58 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:22:59.277521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:59.278569 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:59.306610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:59.307410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:59.308124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:59.309205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:59.309938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:59.310663 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:59.500612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:59.500612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:59.501148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:59.504421 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:59.511525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:59.512041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:59.513340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:59.513794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:59.514095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:59.515487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:59.516299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:59.516943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:59.517324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0433a6c7-218f-49f1-80eb-c4752a1bbd17 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.249838 Aug 29 19:22:59.519636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 178/350] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:22:59 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:22:59.532524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a31a6fef-eaa4-407d-a754-f5aa7768ef79 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:22:59.534239 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a31a6fef-eaa4-407d-a754-f5aa7768ef79 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:22:59.681602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a31a6fef-eaa4-407d-a754-f5aa7768ef79 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:59.693632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a31a6fef-eaa4-407d-a754-f5aa7768ef79 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1213 microversion: 2.1 time: 0.169448 Aug 29 19:22:59.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 179/351] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:59 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:59.769467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:22:59.779339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0bc85a83-6310-4da6-a1b6-9a63f9b9b924 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1514 microversion: 2.1 time: 0.293813 Aug 29 19:22:59.789049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 173/352] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:22:59 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:22:59.807889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-f1c22325-f5a5-48dc-870b-0e65e92dfa3c req-ba034224-3abf-41ff-acd9-4eb373aca509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "name": "network-vif-plugged", "status": "completed", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:22:59.826570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f1c22325-f5a5-48dc-870b-0e65e92dfa3c req-ba034224-3abf-41ff-acd9-4eb373aca509 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:22:59.827091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f1c22325-f5a5-48dc-870b-0e65e92dfa3c req-ba034224-3abf-41ff-acd9-4eb373aca509 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:22:59.827720 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f1c22325-f5a5-48dc-870b-0e65e92dfa3c req-ba034224-3abf-41ff-acd9-4eb373aca509 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:22:59.842880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-f1c22325-f5a5-48dc-870b-0e65e92dfa3c req-ba034224-3abf-41ff-acd9-4eb373aca509 service nova] Creating event network-vif-plugged:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:22:59.848942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-f1c22325-f5a5-48dc-870b-0e65e92dfa3c req-ba034224-3abf-41ff-acd9-4eb373aca509 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053085 Aug 29 19:22:59.850161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 180/353] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:00.568643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:00.569247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:00.584284 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:00.584559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:00.585003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:00.585897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:00.586352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:00.586773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:00.627526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:00.740033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:00.742767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:00.767912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:00.768425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:00.768869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:00.769666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:00.771036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:00.771513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:01.121543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:01.121543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-89e4749c-39cc-4dd3-b241-b121170f48e7 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1209 microversion: 2.1 time: 0.158397 Aug 29 19:23:01.121543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 181/354] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:00 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1209 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:01.122270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:01.122270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:01.122456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:01.122456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4f53978a-6f4b-4e80-824b-4a47d68e68e0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.395260 Aug 29 19:23:01.122456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 174/355] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:00 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:02.117247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:02.119004 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:02.132912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:02.134293 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:02.142807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:02.143567 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:02.144241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:02.145287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:02.145966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:02.146681 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:02.161429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:02.163324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:02.164896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:02.167170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:02.168436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:02.169477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:02.315358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:02.325020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-53f26206-eb26-4fc7-bb80-9bd86e4428a8 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1265 microversion: 2.1 time: 0.212688 Aug 29 19:23:02.352560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 182/356] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:02 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:02.436170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:02.476090 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:02.484464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:02.488743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ffe3ddd3-cd83-4808-b62c-edca28c8fac1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.359653 Aug 29 19:23:02.511885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 175/357] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:02 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:03.357610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:03.360357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:03.379782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:03.380309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:03.380746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:03.381459 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:03.381910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:03.382318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:03.458706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1ae51545-d7fc-46d8-9dd2-a44c8a854b12 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'create', calling method: .version_select at 0x7f1fde6745e0>, body: {"keypair": {"name": "tempest-keypair-49320106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1wnTXcrkKc3j7T1HeRtXwnkyQuDf1HDHnsbvbYRrJb2IimpvjxjfuX53JEtW04RXePojiYH5kPm2XYvjt0q4KPn4nSW90gNhZwdnEipXvY9I+KXZf8jIlhnfkBbgaYzw=="}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:03.477415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-1ae51545-d7fc-46d8-9dd2-a44c8a854b12 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for project fec9a23227784d23ba703719c785e413. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:23:03.484715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-1ae51545-d7fc-46d8-9dd2-a44c8a854b12 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for user bd993c0493d447cb9b02e424a28e24bc and project fec9a23227784d23ba703719c785e413. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:23:03.507841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:03.523732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9a937604-87b2-4978-8b2a-085fadb4a509 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1283 microversion: 2.1 time: 0.170008 Aug 29 19:23:03.524913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 183/358] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:03 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:03.532956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:03.533588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:03.540636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:03.541124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:03.541621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:03.542573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:03.543050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:03.543480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:03.810281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:03.829018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:03.830359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:03.831516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4c34ee7d-a323-4c39-a461-205556ee5d03 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.305346 Aug 29 19:23:03.832099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 184/359] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:03 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:04.091675 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1ae51545-d7fc-46d8-9dd2-a44c8a854b12 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.641867 Aug 29 19:23:04.095294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 176/360] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:23:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:04.547196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:04.547892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:04.561159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:04.562401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:04.562844 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:04.563632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:04.564172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:04.564731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:04.886398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:04.887191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:04.902798 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:04.903373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:04.903997 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:04.905552 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:04.907156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:04.908038 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:05.035578 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:05.053414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8e7e1797-68a7-426b-bf06-31fdefb94547 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.510487 Aug 29 19:23:05.067696 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 185/361] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:04 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:05.262476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:05.276138 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:05.277434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:05.279238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a5ff7856-13b2-4cb3-8afd-6307dbae1397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.428334 Aug 29 19:23:05.292736 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 177/362] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:04 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:05.962161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-a1eb5226-9f5c-4379-9333-d143653252e8 req-1891a7b5-b91e-4efa-96c4-b52e94969032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a07617-c00a-48ae-bf93-8abed4b4458b", "tag": "8471099d-fdf1-4441-81bb-132494b7762a"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:05.999188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a1eb5226-9f5c-4379-9333-d143653252e8 req-1891a7b5-b91e-4efa-96c4-b52e94969032 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:06.003918 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a1eb5226-9f5c-4379-9333-d143653252e8 req-1891a7b5-b91e-4efa-96c4-b52e94969032 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:06.005465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a1eb5226-9f5c-4379-9333-d143653252e8 req-1891a7b5-b91e-4efa-96c4-b52e94969032 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:06.035432 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-a1eb5226-9f5c-4379-9333-d143653252e8 req-1891a7b5-b91e-4efa-96c4-b52e94969032 service nova] Creating event network-changed:8471099d-fdf1-4441-81bb-132494b7762a for instance f3a07617-c00a-48ae-bf93-8abed4b4458b on hv-cinder-85501 Aug 29 19:23:06.048466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-a1eb5226-9f5c-4379-9333-d143653252e8 req-1891a7b5-b91e-4efa-96c4-b52e94969032 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091787 Aug 29 19:23:06.049196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 186/363] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:06.079505 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:06.080278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:06.091096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:06.094974 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:06.096130 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:06.100560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:06.104766 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:06.105500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:06.308190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:06.308600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:06.323274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:06.323577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:06.328984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:06.328984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:06.328984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:06.328984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:06.492274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:06.510893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d83b663c-e2f1-4cc5-b84e-8544a043e757 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.439553 Aug 29 19:23:06.512802 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 178/364] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:06 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:06.600215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:06.610977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:06.612632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:06.613901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6b5c8c63-fbe2-4f51-ac4c-5cbae6a44fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.311181 Aug 29 19:23:06.614845 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 187/365] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:06 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:07.534053 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:07.534703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:07.541864 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:07.542340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:07.542766 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:07.543456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:07.543954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:07.544375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:07.639224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:07.640580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:07.647736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:07.648356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:07.648710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:07.649425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:07.649885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:07.650574 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:07.688372 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:07.695247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-237e5af5-ac10-405b-8857-573eb6e4bef6 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.165672 Aug 29 19:23:07.697091 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 179/366] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:07 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:07.801452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:07.809930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:07.811928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:07.813099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e5573d7e-6215-4f0c-8b2f-0e07c2caf755 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.177897 Aug 29 19:23:07.813647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 188/367] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:07 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:08.745663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:08.749522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:08.749522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:08.755448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:08.755967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:08.756407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:08.757267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:08.757907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:08.758341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:08.783197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1522429012", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcf7c3c4-f23e-4e33-a023-3ee1e56d4ff9"}], "security_groups": [{"name": "tempest-securitygroup--162366597"}], "key_name": "tempest-keypair-49320106", "user_data": "}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:08.934883 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:08.944687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b7e5aa05-a102-4360-afff-1101563c9c27 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.203856 Aug 29 19:23:08.945259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 180/368] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:08 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:08.963278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:08.964069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:08.971687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:08.972235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:08.972672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:08.973577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:08.974126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:08.974736 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:09.137177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:09.148889 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:09.150470 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:09.152031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-768e6fd0-1710-4f03-9513-8dd9ea66ec8b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.205405 Aug 29 19:23:09.153137 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 181/369] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:08 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:09.686286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:09.968208 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:09.970034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:09.978638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:09.984029 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:09.984029 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:10.003579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:10.009431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:10.015951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:10.335217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:10.344396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d676b5e4-5ba7-43f9-bc64-f210622260e1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.381483 Aug 29 19:23:10.356830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 182/370] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:09 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:10.362618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:10.363223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:10.370361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:10.370858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:10.371307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:10.372179 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:10.372668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:10.373073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:10.541893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:10.551346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:10.552885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:10.554164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9f8b13b2-453f-420f-9140-f2aa8add9315 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.208076 Aug 29 19:23:10.555904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 183/371] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:10 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:11.367162 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:11.367876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:11.375484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:11.376020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:11.376457 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:11.377169 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:11.377621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:11.378041 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:11.544020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:11.553960 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b0c9c59a-25c4-4cc2-aaa9-1832ff02d4ce tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.190582 Aug 29 19:23:11.554623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 184/372] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:11 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:11.579015 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:11.579822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:11.585781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:11.586264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:11.586699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:11.587399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:11.587872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:11.588295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:11.727290 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:11.736347 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:11.737778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:11.738928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-88c4025e-7b3a-4cfb-8ce2-d53768ba6397 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.164436 Aug 29 19:23:11.739485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 185/373] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:11 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:12.574934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:12.575594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:12.583933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:12.584623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:12.585065 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:12.586004 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:12.586591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:12.587067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:12.785676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:12.794209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c377553d-f879-475c-91e2-f5a2335a2095 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.223259 Aug 29 19:23:12.794924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 186/374] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:12 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:12.802383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:12.802971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:12.804734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:12.809713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:12.810224 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:12.810655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:12.811503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:12.812132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:12.812557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:12.946793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:12.956189 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:12.957778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:12.959058 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-de858218-1855-4656-9812-4b0372a9d032 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.163156 Aug 29 19:23:12.959642 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 187/375] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:12 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:13.114520 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] validate_networks() for [('dcf7c3c4-f23e-4e33-a023-3ee1e56d4ff9', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:23:13.540354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:23:13.540354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:23:13.540354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:23:13.540354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:23:13.541434 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:23:13.553658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:13.554146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:13.554721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:13.555374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:13.555777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:13.556391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:13.575641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for project fec9a23227784d23ba703719c785e413. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:23:13.580323 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Getting quotas for user bd993c0493d447cb9b02e424a28e24bc and project fec9a23227784d23ba703719c785e413. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:23:13.592319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:23:13.608394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:23:13.809975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-deafc59a-d2c8-4b1f-90e3-e61b8ed8bfaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.031679 Aug 29 19:23:13.814689 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 189/376] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:23:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 5034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:23:13.817178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:13.818153 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:13.821816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c955e662-d53e-4816-b9d0-4c3f5a0b49e8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:13.822557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c955e662-d53e-4816-b9d0-4c3f5a0b49e8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:13.825367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=12 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:13.827948 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:13.828451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:13.828951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:13.829732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:13.830427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:13.831127 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:13.832728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:13.890183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c955e662-d53e-4816-b9d0-4c3f5a0b49e8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:13.898930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c955e662-d53e-4816-b9d0-4c3f5a0b49e8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1244 microversion: 2.1 time: 0.081351 Aug 29 19:23:13.899680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 190/377] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:13 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:13.988951 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:13.989808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:14.012807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:14.012807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:14.012807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:14.012807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:14.013271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:14.014469 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:14.014469 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:14.021406 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f3f55d10-c372-49f7-b825-37cef28f67d5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.208242 Aug 29 19:23:14.036205 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 188/378] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:13 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:14.163993 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:14.172638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:14.174270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:14.175463 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-79fcb7cc-6c99-4b62-a76d-b36562bb8779 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1738 microversion: 2.20 time: 0.195466 Aug 29 19:23:14.176041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 191/379] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:13 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:14.922548 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8fcbbdc1-ac4f-4f68-906f-59852df62c3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:14.923135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8fcbbdc1-ac4f-4f68-906f-59852df62c3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:14.976893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8fcbbdc1-ac4f-4f68-906f-59852df62c3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:14.984788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8fcbbdc1-ac4f-4f68-906f-59852df62c3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1244 microversion: 2.1 time: 0.066393 Aug 29 19:23:14.991080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 189/380] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:14 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:15.043667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:15.044317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:15.051666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:15.052185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:15.052614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:15.053442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:15.054472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:15.054900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:15.201187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:15.202069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:15.209728 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:15.211846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:15.211846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:15.211846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:15.212335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:15.212448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:15.535610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:15.539779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a9d47976-3d3b-41f7-a723-b25d24426c9a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.501016 Aug 29 19:23:15.540358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 192/381] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:15 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:15.652725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:15.661851 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:15.663456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:15.673254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-84591065-7733-4cfc-a1df-eb0cbc0a1b09 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1720 microversion: 2.20 time: 0.468933 Aug 29 19:23:15.673254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 190/382] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:15 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1720 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:16.010391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:16.014913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:16.022345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:16.023048 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:16.024307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:16.025181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:16.025792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:16.026503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:16.093374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:16.101398 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-570ce3c1-d6df-4b00-bd9a-3b05d3654f2b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1248 microversion: 2.1 time: 0.098188 Aug 29 19:23:16.101994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 193/383] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:16 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:16.562004 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:16.562612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:16.569453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:16.569932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:16.570366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:16.571055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:16.571506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:16.572012 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:16.691416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:16.705309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:16.705309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:16.705309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:16.705309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:16.706088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:16.706088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:16.706088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:16.708884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:16.719395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9bfc793d-d398-4334-b8bd-a2fa5c17c601 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.161122 Aug 29 19:23:16.719949 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 191/384] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:16 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:16.848916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:16.858005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:16.859534 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:16.861125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7109f2a0-e31b-4e88-a894-054a84746d01 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1720 microversion: 2.20 time: 0.173731 Aug 29 19:23:16.861716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 194/385] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:16 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:17.122919 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:17.124282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:17.130676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:17.131200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:17.131724 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:17.132603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:17.133120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:17.133641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:17.198154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:17.201585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:17.205929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fdd3d999-9f75-423d-ac23-313e81741c0c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1240 microversion: 2.1 time: 0.087276 Aug 29 19:23:17.206477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 192/386] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:17 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:17.742771 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:17.750563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:17.750563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:17.750563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:17.750959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:17.751719 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:17.752215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:17.752639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:17.886703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:17.888077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:17.896812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:17.908876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:17.908876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:17.909287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:17.909579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:17.909579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:17.909579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:17.909827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6ad9e247-3bc1-48e5-a2e4-f0a4b18e72da tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.169247 Aug 29 19:23:17.909827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 195/387] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:17 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:18.038132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:18.048145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:18.049436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:18.050708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-287c2941-9352-418f-a132-f01b07274c83 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1720 microversion: 2.20 time: 0.168626 Aug 29 19:23:18.051262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 193/388] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:17 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:18.160427 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-c55b65d5-720e-410f-87a2-a69157e0758b req-e584d8b5-b047-4740-b5a3-172ec67580f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a07617-c00a-48ae-bf93-8abed4b4458b", "name": "network-vif-plugged", "status": "completed", "tag": "8471099d-fdf1-4441-81bb-132494b7762a"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:18.171428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c55b65d5-720e-410f-87a2-a69157e0758b req-e584d8b5-b047-4740-b5a3-172ec67580f6 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:18.171576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c55b65d5-720e-410f-87a2-a69157e0758b req-e584d8b5-b047-4740-b5a3-172ec67580f6 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:18.172220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c55b65d5-720e-410f-87a2-a69157e0758b req-e584d8b5-b047-4740-b5a3-172ec67580f6 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:18.185159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-c55b65d5-720e-410f-87a2-a69157e0758b req-e584d8b5-b047-4740-b5a3-172ec67580f6 service nova] Creating event network-vif-plugged:8471099d-fdf1-4441-81bb-132494b7762a for instance f3a07617-c00a-48ae-bf93-8abed4b4458b on hv-cinder-85501 Aug 29 19:23:18.191023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-c55b65d5-720e-410f-87a2-a69157e0758b req-e584d8b5-b047-4740-b5a3-172ec67580f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Aug 29 19:23:18.191633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 196/389] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:18.226437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:18.227037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:18.233523 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:18.254021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:18.254021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:18.254021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:18.254021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:18.254404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:18.298687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:18.306299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-005cb019-740d-4ed2-a33b-9ef46d65191a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1240 microversion: 2.1 time: 0.083962 Aug 29 19:23:18.307503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 194/390] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:18 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:18.931372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:18.932135 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:18.938783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:18.939271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:18.939753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:18.940637 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:18.941099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:18.941525 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.075563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:19.076209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:19.085021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:19.091234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:19.091234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.091234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:19.091234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:19.091895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.092008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:19.098169 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-540b1243-2224-4d5d-8af1-19a61e8f133e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.171259 Aug 29 19:23:19.099058 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 197/391] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:18 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:19.241339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:19.251003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:19.253530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:19.254847 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-72aaa47f-f2cb-4ad7-bc24-45213d6cb5ef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1723 microversion: 2.20 time: 0.184218 Aug 29 19:23:19.255412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 195/392] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:19 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:19.278478 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c62b25a1-172d-4168-b8e9-97ba22c3473f"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:19.281006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:19.287095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:19.287579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:19.288121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.289213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:19.289481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:19.289908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.326584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:19.327183 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:19.333201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:19.333677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:19.334104 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.334793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:19.335240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:19.335659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:19.401877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:19.410034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e04aca20-c390-44f2-88b1-de4f73b61459 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1296 microversion: 2.1 time: 0.087628 Aug 29 19:23:19.410718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 196/393] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:19 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:20.120461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:20.121110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:20.129325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:20.129811 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:20.130238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:20.130931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:20.131373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:20.131822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:20.282512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:20.290548 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-62d31d39-8788-405c-8a1d-1b292bcef4c9 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1313 microversion: 2.1 time: 0.173909 Aug 29 19:23:20.295986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 197/394] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:20 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:20.296187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-01519152-d16a-4912-ac7c-58f7bb4d0d13 req-d3ccc233-85e9-440c-9f5b-1a109d1834e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "name": "network-vif-unplugged", "status": "completed", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:20.305631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-01519152-d16a-4912-ac7c-58f7bb4d0d13 req-d3ccc233-85e9-440c-9f5b-1a109d1834e4 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:20.306104 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-01519152-d16a-4912-ac7c-58f7bb4d0d13 req-d3ccc233-85e9-440c-9f5b-1a109d1834e4 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:20.306559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-01519152-d16a-4912-ac7c-58f7bb4d0d13 req-d3ccc233-85e9-440c-9f5b-1a109d1834e4 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:20.318170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-01519152-d16a-4912-ac7c-58f7bb4d0d13 req-d3ccc233-85e9-440c-9f5b-1a109d1834e4 service nova] Creating event network-vif-unplugged:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:23:20.323301 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-01519152-d16a-4912-ac7c-58f7bb4d0d13 req-d3ccc233-85e9-440c-9f5b-1a109d1834e4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031054 Aug 29 19:23:20.323999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 198/395] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:20.430867 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:20.431742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:20.439643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:20.440322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:20.446178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:20.446178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:20.446178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:20.446178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:20.512164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:20.519742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-10f3e3fe-1fba-48b9-b522-a94a390b8161 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1304 microversion: 2.1 time: 0.093448 Aug 29 19:23:20.520507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 199/396] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:20 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:20.861110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:21.314004 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:21.314659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:21.328969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:21.329463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:21.329896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:21.330602 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:21.331053 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:21.331471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:21.530973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:21.538310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7417a1b0-9c41-48df-bb1a-74b8c95d515a tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1498 microversion: 2.1 time: 0.229199 Aug 29 19:23:21.538886 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 200/397] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:21 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1498 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:21.544003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:21.544863 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:21.551363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:21.552159 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:21.552588 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:21.553327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:21.554086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:21.554693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:21.575711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d9028b95-5138-4d10-b946-2cab1948b2bb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.301710 Aug 29 19:23:21.579337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 198/398] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Aug 29 19:23:19 2022] POST /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 188 bytes in 2306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:23:21.682200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:21.690465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d6e0558c-845e-465a-9f1f-7920eed364d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1304 microversion: 2.1 time: 0.150187 Aug 29 19:23:21.691041 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 201/399] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:21 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:22.335145 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:22.336357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:22.345053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:22.347736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:22.348379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:22.349422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:22.350187 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:22.350798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:22.416527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121336) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:23:22.711984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:22.712690 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:22.719317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:22.719800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:22.720452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:22.721147 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:22.721600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:22.722023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:22.794787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-04119d33-e163-4240-9893-5a7bc9479706 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/action" status: 202 len: 0 microversion: 2.20 time: 0.463733 Aug 29 19:23:22.795773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 199/400] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 19:23:22 2022] POST /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:23:22.807330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:22.808337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:22.815731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:22.816582 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:22.817228 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:22.818586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:22.819547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:22.820127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:22.906555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:22.914294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-25ac9d65-ac67-4c79-98a5-c33de241c031 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.206165 Aug 29 19:23:22.914899 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 202/401] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:22 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:23.057342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:23.058197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:23.069150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.070192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.070620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:23.071518 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.072373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.072897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:23.084388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:23.098119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:23.112212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:23.113625 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-39247fce-37ad-4ca9-8bb2-4959922ac0e5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1749 microversion: 2.20 time: 0.312374 Aug 29 19:23:23.117695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 200/402] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:22 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1749 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:23.120105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:23:23.391089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-ccbdcb6b-bd2a-4fb7-832f-b5fa757259fa req-0cc523aa-1b3a-4b6d-baee-74de080c553f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec9ec5e-04e7-4ed4-9611-4a2bcecd198e", "tag": "38405fa8-e5ca-4cb4-b875-6558d2f3759b"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:23.402742 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-ccbdcb6b-bd2a-4fb7-832f-b5fa757259fa req-0cc523aa-1b3a-4b6d-baee-74de080c553f service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.403302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-ccbdcb6b-bd2a-4fb7-832f-b5fa757259fa req-0cc523aa-1b3a-4b6d-baee-74de080c553f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.403966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-ccbdcb6b-bd2a-4fb7-832f-b5fa757259fa req-0cc523aa-1b3a-4b6d-baee-74de080c553f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:23.430714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-ccbdcb6b-bd2a-4fb7-832f-b5fa757259fa req-0cc523aa-1b3a-4b6d-baee-74de080c553f service nova] Creating event network-changed:38405fa8-e5ca-4cb4-b875-6558d2f3759b for instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e on hv-cinder-85501 Aug 29 19:23:23.430714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-ccbdcb6b-bd2a-4fb7-832f-b5fa757259fa req-0cc523aa-1b3a-4b6d-baee-74de080c553f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041789 Aug 29 19:23:23.431761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 201/403] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:23.577272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4c796407-a1c2-4556-b1b9-e6a3a15a2ab5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 204 len: 0 microversion: 2.1 time: 0.523933 Aug 29 19:23:23.577858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 203/404] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:23:23 2022] DELETE /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:23:23.583142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:23.587217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:23.589273 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:23.596763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.607031 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.612484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:23.619493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.619493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.619493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:23.773662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:23.783566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-63b40c64-71e7-4f97-b02e-41fa6782bd7f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1504 microversion: 2.1 time: 0.201266 Aug 29 19:23:23.784178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 202/405] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:23 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:23.937574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:23.938302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:23.945184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.945668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.946196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:23.946900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:23.947344 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:23.947761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:24.100052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:24.108755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-78a94b5d-f9f7-4f62-a47c-90c07ef6ce72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.175386 Aug 29 19:23:24.109499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 204/406] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:23 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:24.143367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:24.144011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:24.146337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=8 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:24.151444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:24.151950 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:24.152380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:24.153075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:24.153527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:24.153983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:24.309193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:24.318049 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:24.319504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:24.320875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-68518b7e-1224-441b-bfe5-50bfefe7a0ff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1749 microversion: 2.20 time: 0.181358 Aug 29 19:23:24.326316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 203/407] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:24 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:24.805002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:24.805598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:24.811553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:24.812064 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:24.812493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:24.813177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:24.813623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:24.814043 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:24.958065 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:24.966311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a49e2428-8a9f-43e0-8157-ec86d562d72e tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1504 microversion: 2.1 time: 0.165037 Aug 29 19:23:24.967490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 205/408] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:24 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:25.135078 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:25.145368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:25.145368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:25.145368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:25.145368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:25.145855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:25.145855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:25.145855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:25.297720 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:25.305806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c90787d8-7f7e-4c05-8d57-f9cdeed13b15 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.179230 Aug 29 19:23:25.306655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 204/409] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:25 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:25.344111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:25.344716 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:25.350512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:25.350990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:25.351651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:25.352206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:25.352579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:25.353082 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:25.497200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:25.513572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:25.515022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:25.516236 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f56a32e2-940f-44b8-b61d-6fcaa0959f3c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1749 microversion: 2.20 time: 0.176088 Aug 29 19:23:25.516800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 206/410] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:25 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:25.995395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:25.996042 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:26.002284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:26.002768 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:26.003198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:26.003917 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:26.004374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:26.004794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:26.144543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:26.156440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fcb2db4d-ea6c-4ec4-a71d-f0340ed9ae87 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1504 microversion: 2.1 time: 0.164710 Aug 29 19:23:26.156833 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 205/411] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:25 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:26.327581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:26.328349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:26.336732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:26.336732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:26.336732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:26.336732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:26.337089 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:26.337312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:26.494141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:26.505065 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bbab23a1-149d-4f35-a8ab-79cd9e680d97 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.181799 Aug 29 19:23:26.511968 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 207/412] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:26 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:26.539483 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:26.541432 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:26.548299 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:26.548895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:26.549357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:26.550278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:26.550738 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:26.551162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:26.697298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:26.708443 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:26.710183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:26.712122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-35b3e141-3c25-4878-9730-77fadcee7a91 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1749 microversion: 2.20 time: 0.176642 Aug 29 19:23:26.724104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 206/413] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:26 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1749 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:27.179173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:27.180344 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:27.182751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:27.192792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:27.192792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:27.192792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:27.192792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:27.193121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:27.193121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:27.213995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:27.332686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:27.344560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2ae244cf-5166-4f62-ac44-d9f41fb45dcd tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1504 microversion: 2.1 time: 0.170427 Aug 29 19:23:27.345249 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 208/414] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:27 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:27.527152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:27.527766 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:27.535716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:27.536364 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:27.536784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:27.537680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:27.538545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:27.539200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:27.708906 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:27.717369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2350e2eb-6b3b-4e8f-98b2-cceaef92355b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.193563 Aug 29 19:23:27.717941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 207/415] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:27 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:27.736483 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:27.737082 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:27.744756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:27.745265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:27.745696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:27.746498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:27.746826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:27.747241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:27.885062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:27.894708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:27.896764 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:27.897657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cf8a084d-45c4-46ed-b6a6-3994b237e4af tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1749 microversion: 2.20 time: 0.165618 Aug 29 19:23:27.898222 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 209/416] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:27 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:28.368330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:28.368755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:28.375192 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:28.375895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:28.376324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:28.377257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:28.378024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:28.378272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:28.662155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:28.674574 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bd50c758-f0fd-49ea-8e6c-e8c7f9b27fb5 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1504 microversion: 2.1 time: 0.310420 Aug 29 19:23:28.675436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 208/417] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:28 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:28.741018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:28.741018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:28.749576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:28.749754 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:28.750220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:28.750928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:28.751385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:28.751818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:28.922178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:28.923279 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:28.930324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:28.931045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:28.931728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:28.932504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:28.932967 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:28.933390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:28.981765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:28.995114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-55108ae8-2ac4-47cb-b20c-b018f8f143c2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.260286 Aug 29 19:23:28.995756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 210/418] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:28 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:29.000657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-05239347-7547-472d-880a-d09133fbc788 req-9b7dc3ad-c32c-413a-8232-744e534df17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a07617-c00a-48ae-bf93-8abed4b4458b", "name": "network-vif-deleted", "tag": "8471099d-fdf1-4441-81bb-132494b7762a"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:29.015521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-05239347-7547-472d-880a-d09133fbc788 req-9b7dc3ad-c32c-413a-8232-744e534df17a service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:29.016050 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-05239347-7547-472d-880a-d09133fbc788 req-9b7dc3ad-c32c-413a-8232-744e534df17a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:29.016488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-05239347-7547-472d-880a-d09133fbc788 req-9b7dc3ad-c32c-413a-8232-744e534df17a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:29.028053 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-05239347-7547-472d-880a-d09133fbc788 req-9b7dc3ad-c32c-413a-8232-744e534df17a service nova] Creating event network-vif-deleted:8471099d-fdf1-4441-81bb-132494b7762a for instance f3a07617-c00a-48ae-bf93-8abed4b4458b on hv-cinder-85501 Aug 29 19:23:29.033902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-05239347-7547-472d-880a-d09133fbc788 req-9b7dc3ad-c32c-413a-8232-744e534df17a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036845 Aug 29 19:23:29.038070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 211/419] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:29.098576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:29.107189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:29.108686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:29.109819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9daa133e-f9a8-463c-b5f6-851196fa8628 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1751 microversion: 2.20 time: 0.192363 Aug 29 19:23:29.110858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 209/420] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:28 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:29.701771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:29.702466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:29.708891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:29.709377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:29.709815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:29.710512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:29.710967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:29.711397 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:29.776697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:29.785371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4ae4714e-fd7f-4e1c-a137-347e643e693f tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1462 microversion: 2.1 time: 0.087764 Aug 29 19:23:29.785955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 212/421] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:29 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:30.015357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:30.015996 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:30.021905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.022376 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.022799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.023617 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.024088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.024505 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.133334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:30.134208 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:30.140352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.140699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.146555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.146555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.146555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.146555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.179287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:30.186776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a17a779d-97fd-4a7a-a9b5-370499a646f6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.175147 Aug 29 19:23:30.187227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 210/422] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:30 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:30.310560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:30.320025 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:30.321607 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:30.322786 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8074b6f4-aedf-460b-ad33-3a1256366cae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1751 microversion: 2.20 time: 0.193572 Aug 29 19:23:30.326439 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 213/423] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:30 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:30.806868 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:30.807477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:30.814337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.814900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.815295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.816008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.816462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.820688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.849497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:30.849986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:30.850422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:30.850863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lazy-loading 'fault' on Instance uuid f3a07617-c00a-48ae-bf93-8abed4b4458b {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:23:30.900036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4092e9fbe24b2ca2f9c283cf22b68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da6d7509a64c8b904d8220993af210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:30.909140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8a885337-b50c-49d6-ac05-029b28e55844 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 200 len: 1303 microversion: 2.1 time: 0.106051 Aug 29 19:23:30.909749 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 211/424] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:30 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:31.206977 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:31.207590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:31.214096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:31.214934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:31.215379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:31.216107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:31.217244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:31.217806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:31.351266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:31.352014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:31.358707 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:31.359471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:31.360127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:31.361278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:31.362069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:31.362668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:31.371489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:31.380748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5b6d5fe2-22d0-42e9-9551-60baa27da042 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.177529 Aug 29 19:23:31.384353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 214/425] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:31 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:31.578187 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:31.589716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:31.593218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:31.593218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d7f853cb-88d4-4a86-8808-6d897e456635 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.248179 Aug 29 19:23:31.593621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 212/426] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:31 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:31.932430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:31.933193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] [instance: f3a07617-c00a-48ae-bf93-8abed4b4458b] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:31.941852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:31.942348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:31.942822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:31.943782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:31.944668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:31.945741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:31.960336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] HTTP exception thrown: Instance f3a07617-c00a-48ae-bf93-8abed4b4458b could not be found. Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Request method failure captured: Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b HTTP/1.1 Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHhBqi_CZwg8rMuoguFB2opeLJ8_8z6u2XfhcJblNkDVDUx-w3MW7qDNMp_SFVEE8pWq0qMQmCWnHploSmqaHL5Hk-KyQwWbQfLK-zcb7QdmvE5ULwCuulNRg00fqx2X9suTw7V0ZhLd603AYK_72GjPY32ky2CRuIB-jhbuUSj2fw Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 30da6d7509a64c8b904d8220993af210 Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-VolumesActionsTest-446682927 Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:23:31.961981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30da6d7509a64c8b904d8220993af210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/30da6d7509a64c8b904d8220993af210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/30da6d7509a64c8b904d8220993af210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_30da6d7509a64c8b904d8220993af210"}]}] Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-VolumesActionsTest-446682927 Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 30da6d7509a64c8b904d8220993af210 Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-VolumesActionsTest-446682927 Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-VolumesActionsTest-446682927-project Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 5d4092e9fbe24b2ca2f9c283cf22b68c Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-VolumesActionsTest-446682927-project Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance f3a07617-c00a-48ae-bf93-8abed4b4458b could not be found. Aug 29 19:23:31.963281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'f3a07617-c00a-48ae-bf93-8abed4b4458b'} Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a07617-c00a-48ae-bf93-8abed4b4458b could not be found. Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:23:31.964099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a07617-c00a-48ae-bf93-8abed4b4458b could not be found. Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a07617-c00a-48ae-bf93-8abed4b4458b could not be found. Aug 29 19:23:31.965360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:23:31.966679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] Returning 404 to user: Instance f3a07617-c00a-48ae-bf93-8abed4b4458b could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:23:31.966679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f1c2c128-7af4-48cc-b14f-dbfd93fc3ad1 tempest-VolumesActionsTest-446682927 tempest-VolumesActionsTest-446682927-project] 10.222.0.62 "GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b" status: 404 len: 111 microversion: 2.1 time: 0.035901 Aug 29 19:23:31.966679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 215/427] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:31 2022] GET /compute/v2.1/servers/f3a07617-c00a-48ae-bf93-8abed4b4458b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:23:32.407220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:32.409700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:32.421915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:32.422889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:32.423581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:32.424589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:32.425222 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:32.426701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:32.463039 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:32.617036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:32.618199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:32.629910 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:32.630649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:32.631253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:32.634854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:32.634854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:32.634854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:32.697648 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:32.706307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-534753df-2406-4c4f-a6b9-f8c01b70cba6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.305549 Aug 29 19:23:32.706899 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 213/428] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:32 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:32.796544 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:32.811441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:32.813315 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:32.814574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9bebb2f2-5e9a-4a03-8f84-e3ab1843c483 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.201800 Aug 29 19:23:32.816419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 216/429] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:32 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:33.728971 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:33.731744 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:33.738467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:33.739403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:33.741869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:33.743155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:33.744260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:33.745829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:33.847407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:33.848239 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:33.861331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:33.861911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:33.862482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:33.867628 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:33.868247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:33.868717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:33.948406 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:33.963615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9c8bdfac-df33-4f80-8e3f-e9d9a8cbc379 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.238726 Aug 29 19:23:33.964362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 214/430] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:33 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:34.183063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-89eed675-6fb5-4cb0-979d-7033e63971dd req-25b2e594-cd21-49e4-aeb3-fd72233e6fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec9ec5e-04e7-4ed4-9611-4a2bcecd198e", "name": "network-vif-plugged", "status": "completed", "tag": "38405fa8-e5ca-4cb4-b875-6558d2f3759b"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:34.191764 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:34.206266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:34.207711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:34.209128 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-89eed675-6fb5-4cb0-979d-7033e63971dd req-25b2e594-cd21-49e4-aeb3-fd72233e6fa0 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:34.209312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-879b5b2f-6025-44af-ae64-9d90fd5e1917 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.371572 Aug 29 19:23:34.210648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 217/431] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:33 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:34.217978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-89eed675-6fb5-4cb0-979d-7033e63971dd req-25b2e594-cd21-49e4-aeb3-fd72233e6fa0 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:34.218528 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-89eed675-6fb5-4cb0-979d-7033e63971dd req-25b2e594-cd21-49e4-aeb3-fd72233e6fa0 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:34.239340 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-89eed675-6fb5-4cb0-979d-7033e63971dd req-25b2e594-cd21-49e4-aeb3-fd72233e6fa0 service nova] Creating event network-vif-plugged:38405fa8-e5ca-4cb4-b875-6558d2f3759b for instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e on hv-cinder-85501 Aug 29 19:23:34.245187 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-89eed675-6fb5-4cb0-979d-7033e63971dd req-25b2e594-cd21-49e4-aeb3-fd72233e6fa0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066093 Aug 29 19:23:34.255131 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 215/432] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:34.992251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:34.994625 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:35.011639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:35.012708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:35.013957 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:35.015174 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:35.015898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:35.016887 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:35.195981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:35.204127 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9abea77a-7282-4e10-8830-91fb2b5e803d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.217568 Aug 29 19:23:35.204923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 218/433] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:34 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:35.237555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:35.238925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:35.254856 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:35.255595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:35.256233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:35.257115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:35.257728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:35.264603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:35.436212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:35.445208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:35.446551 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:35.447686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-54ea7242-d995-49c2-b83d-6d8e81fd36c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.215540 Aug 29 19:23:35.448376 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 216/434] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:35 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:36.224684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:36.225420 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:36.241601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:36.243150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:36.243150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:36.243374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:36.243621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:36.244074 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:36.474050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:36.475632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:36.487793 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:36.489863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:36.490804 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:36.492399 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:36.494437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:36.494962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:36.510421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:36.530196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e7728aed-d0dd-4b72-9797-33a172694184 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.307127 Aug 29 19:23:36.537731 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 219/435] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:36 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:36.742573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:36.753176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:36.755588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:36.758701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b6c706c7-de15-4e27-b4f9-d5c9f9ce673a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.291810 Aug 29 19:23:36.759294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 217/436] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:36 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:37.555241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:37.556735 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:37.565708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:37.566530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:37.567717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:37.570741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:37.572145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:37.574924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:37.782320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:37.785125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:37.813130 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:37.820127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:37.820127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:37.820127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:37.820127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:37.820529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:38.012670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:38.023149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:38.027033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:38.029752 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:38.031973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-02c940e7-16e4-48eb-b7a4-df766224dad2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.253108 Aug 29 19:23:38.036016 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 218/437] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:37 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:38.044862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-073dd978-8307-4052-88b4-3dfabddbb7ac tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.495367 Aug 29 19:23:38.058877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 220/438] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:37 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:39.058365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:39.059036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:39.065934 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:39.066722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:39.067230 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:39.068228 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:39.068905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:39.069526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:39.090374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:39.102128 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:39.115758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:39.116530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:39.117357 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:39.118228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:39.128702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:39.129498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:39.443467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:39.455433 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:39.458194 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:39.459575 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e4351f2f-2501-4d6c-bb05-3e57ce07ca8d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.405308 Aug 29 19:23:39.470576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 219/439] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:39 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:39.519718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:39.529829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1d300a39-42e4-45b7-8d5c-2b7752acbdd7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.446564 Aug 29 19:23:39.531631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 221/440] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:39 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:40.528193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:40.528193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:40.528193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:40.528193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:40.529318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:40.529318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:40.529318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:40.538772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:40.554939 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:40.556335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:40.581566 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:40.582032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:40.586235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:40.592653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:40.600441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:40.601175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:41.024229 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:41.060403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:41.075034 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:41.075884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:41.078489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a62a4b0a-087c-4b6d-8040-bdf56c5f43a7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.579612 Aug 29 19:23:41.084131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d15df458-ebd6-47a5-bf7b-3f47ac08d8d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.535014 Aug 29 19:23:41.087905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 220/441] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:40 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:41.107335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 222/442] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:40 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:23:42.110765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:42.112302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:42.113506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:42.116698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:42.126974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:42.127482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:42.132704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:42.133066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:42.133191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:42.133191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:42.133383 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:42.133489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:42.133489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:42.134183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:42.136428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:42.138836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:42.503659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:42.513066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:42.523835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:42.528374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:42.530518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c2e0c55e-7e05-4628-b696-c12844d233ed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.425810 Aug 29 19:23:42.531422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 221/443] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:42 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:42.532618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-553af165-a56a-407c-86f6-6c2531fb096e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.424434 Aug 29 19:23:42.550435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 223/444] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:42 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:43.564493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:43.565675 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:43.569473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:43.570147 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:43.584475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:43.584978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:43.585423 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:43.586153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:43.586610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:43.588982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:43.592834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:43.592834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:43.592834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:43.592834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:43.593241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:43.593348 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:43.847219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:43.856419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b3957f8d-ea78-437a-bc09-b919f488d4ab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.304452 Aug 29 19:23:43.870982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 222/445] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:43 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:43.893281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:43.904529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:43.906231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:43.907415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-15e8be1b-f4a0-4f8f-b7e5-7746c6a10cfa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.352822 Aug 29 19:23:43.923037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 224/446] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:43 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:44.883199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:44.885978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:44.904064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:44.907057 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:44.909816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:44.917496 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:44.920650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:44.922245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:44.930862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:44.931497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:44.943838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:44.951876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:44.952405 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:44.953171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:44.953635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:44.954079 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:45.352625 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:45.366583 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:45.371126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-af77a684-015f-414a-b681-6db601e17665 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.494828 Aug 29 19:23:45.384253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 223/447] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:44 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:45.393659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:45.395366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:45.425409 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ec58a708-4cf2-4f39-8680-3e7538bbee7b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.470158 Aug 29 19:23:45.425409 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 225/448] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:44 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:46.395916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:46.397403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:46.407429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:46.412907 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:46.413730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:46.414648 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:46.415543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:46.418703 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:46.447416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:46.448659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:46.461459 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:46.467146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:46.474448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:46.475344 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:46.475881 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:46.476314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:46.558297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:46.980710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:46.993490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-38abec70-bd0a-4fa3-856b-8f5024e6d449 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1369 microversion: 2.1 time: 0.603379 Aug 29 19:23:46.996620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 224/449] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:46 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1369 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:47.774202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:47.793678 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:47.797127 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:47.800979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f85ec0f8-b9cc-41e5-8565-a4526b1639b0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 1.356769 Aug 29 19:23:47.802514 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 226/450] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:46 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:48.019697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:48.021055 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:48.031296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:48.032190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:48.032865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:48.033726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:48.034314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:48.034815 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:48.233552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:48.244106 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8f024634-e4c2-4d1f-83d8-8c55f9ccffa7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1563 microversion: 2.1 time: 0.229309 Aug 29 19:23:48.264501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 225/451] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:23:48 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:23:48.271105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:48.272087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:48.279542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:48.280355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:48.281369 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:48.282816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:48.283805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:48.284822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:48.479331 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0f355a93-52b5-4910-91e5-e4deb2fe7557 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212898 Aug 29 19:23:48.481014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 227/452] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:23:48 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:48.865082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:48.865082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:48.875462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:48.878546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:48.878918 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:48.879654 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:48.880306 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:48.880726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:49.300133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:49.313087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:49.315887 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:49.317919 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6cdadc48-42b6-4e1b-a3d3-07f54ee9fcb2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.458045 Aug 29 19:23:49.319899 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 226/453] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:48 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:50.103788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-376927a3-20a2-46cc-82a9-2d10d6153c89 req-9670378e-61b0-4211-9d0e-6324d591d368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec9ec5e-04e7-4ed4-9611-4a2bcecd198e", "tag": "38405fa8-e5ca-4cb4-b875-6558d2f3759b"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:50.111432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:50.118214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-376927a3-20a2-46cc-82a9-2d10d6153c89 req-9670378e-61b0-4211-9d0e-6324d591d368 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:50.118214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-376927a3-20a2-46cc-82a9-2d10d6153c89 req-9670378e-61b0-4211-9d0e-6324d591d368 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:50.118214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-376927a3-20a2-46cc-82a9-2d10d6153c89 req-9670378e-61b0-4211-9d0e-6324d591d368 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:50.130208 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-376927a3-20a2-46cc-82a9-2d10d6153c89 req-9670378e-61b0-4211-9d0e-6324d591d368 service nova] Creating event network-changed:38405fa8-e5ca-4cb4-b875-6558d2f3759b for instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e on hv-cinder-85501 Aug 29 19:23:50.135761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-376927a3-20a2-46cc-82a9-2d10d6153c89 req-9670378e-61b0-4211-9d0e-6324d591d368 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036623 Aug 29 19:23:50.137183 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 228/454] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:50.345020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:50.346023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:50.362693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:50.365221 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:50.365709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:50.366456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:50.366902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:50.367321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:50.692904 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:50.704546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:50.718099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:50.719382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2c112b28-f957-47c6-96f0-25b21ffda69e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.380522 Aug 29 19:23:50.719986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 227/455] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:50 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:51.753480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:51.755097 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:51.776686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:51.780657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:51.781419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:51.782384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:51.786057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:51.786988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:52.070590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:52.083206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:52.088875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:52.090068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a73ea4bc-311e-4e75-a6f4-d7f186480b67 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.346871 Aug 29 19:23:52.090768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 229/456] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:51 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:53.114848 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:53.115566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:53.118076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:53.123729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:53.124328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:53.124863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:53.125622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:53.126142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:53.126622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:53.286874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:53.296393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:53.298223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:53.299120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d46d9dd0-719c-40be-a591-460e5012f14a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.188512 Aug 29 19:23:53.299673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 228/457] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:53 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:54.328584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:54.331051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:54.392980 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:54.394276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:54.396580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:54.397332 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:54.397796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:54.398254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:54.582953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:54.594985 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:54.596890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:54.598348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-453d487f-a0a0-408d-bc16-969c945a0de6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.277109 Aug 29 19:23:54.611374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 230/458] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:54 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:55.193842 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a97fb469-8cf9-4aef-a732-97b5291a6691 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Action: 'create', calling method: .version_select at 0x7f1fde66ce50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1637069204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIu0PHtLqcGM8sPvy0XZ1hdvKHMBF/tqKRmy29Q3k199F9pr3OlDwAjK3QJ4XGUlVuh52I+4HLKqxFMZhlUmCma4P4Kaxain8HpIRAAzxQ4nKWi4zGT7cTZzsqWa+afd4g=="}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:23:55.279815 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-a97fb469-8cf9-4aef-a732-97b5291a6691 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Getting quotas for project ce2ee7950a334c8888dae733cb698533. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:23:55.291927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-a97fb469-8cf9-4aef-a732-97b5291a6691 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Getting quotas for user a111fd5f36324d75ac8ad55e762aeaca and project ce2ee7950a334c8888dae733cb698533. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:23:55.417810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a97fb469-8cf9-4aef-a732-97b5291a6691 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.526365 Aug 29 19:23:55.419914 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 229/459] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:23:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:23:55.622719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:55.623967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:55.633574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:55.636854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:55.637634 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:55.638586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:55.640412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:55.641125 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:56.273917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:56.296105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:56.305828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:56.308061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ef7bb2a0-9feb-44f0-8b79-a2af4b52a731 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.689751 Aug 29 19:23:56.325650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 231/460] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:55 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:23:57.351898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:57.352626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:57.365871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:57.366471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:57.367089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:57.368923 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:57.370747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:57.371315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:57.602152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:57.614933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:57.616657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:57.617886 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-19340d7a-38d9-4d56-922b-a6fc89552882 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.272393 Aug 29 19:23:57.618820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 230/461] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:57 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:23:58.643499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:23:58.646445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:23:58.652938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:58.653435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:58.653874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:58.654588 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:23:58.655037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:23:58.655711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:23:58.999461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:59.010456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:59.012902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:23:59.022352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-052dd8fb-aa57-4842-b224-f6460f88914a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.374979 Aug 29 19:23:59.022352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 232/462] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:23:58 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:00.042344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:00.045539 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:00.099379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:00.099379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:00.099379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:00.099379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:00.100736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:00.100736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:00.377058 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:00.381353 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:00.389192 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:00.391343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:00.392817 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a78939be-e88d-48fc-b06e-78654cf7fbec tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.357512 Aug 29 19:24:00.393900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 231/463] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:00 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:01.258173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:01.259333 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:01.282192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:01.283597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:01.283597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:01.283947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:01.287045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:01.290293 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:01.336184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-800d950a-ca24-4ff0-9ad9-686aef30f17b tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/ips" status: 200 len: 144 microversion: 2.1 time: 0.084068 Aug 29 19:24:01.346615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 233/464] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:24:01 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/ips => generated 144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:01.419729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:01.420409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:01.431414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:01.434342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:01.434869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:01.435907 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:01.437130 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:01.437838 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:01.686330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:01.710264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:01.711745 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:01.713015 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f1dbd0f5-08e8-45ec-9bc4-278e534b300e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.298082 Aug 29 19:24:01.713575 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 232/465] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:01 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:02.746601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:02.746601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:02.765180 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:02.766155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:02.767001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:02.768135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:02.768956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:02.769589 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:02.965976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:02.980539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:02.984109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:02.985648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5c170d96-51f7-4348-aaa3-95a34c47aa40 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.248249 Aug 29 19:24:02.989425 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 234/466] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:02 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:04.022200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:04.024589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:04.037546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:04.038726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:04.039681 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:04.041134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:04.042169 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:04.043182 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:04.385597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:04.402515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:04.406338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:04.412172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-95858a4c-3bf6-4c18-9adf-8bbca7178e26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.397243 Aug 29 19:24:04.428344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 233/467] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:04 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:05.429456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-af0601d8-3625-4ce3-920d-1d34d7c59cdf req-00dce150-07a5-4536-b8e2-b4b166e9ff59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "name": "network-vif-plugged", "status": "completed", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:05.444197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-af0601d8-3625-4ce3-920d-1d34d7c59cdf req-00dce150-07a5-4536-b8e2-b4b166e9ff59 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:05.444941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-af0601d8-3625-4ce3-920d-1d34d7c59cdf req-00dce150-07a5-4536-b8e2-b4b166e9ff59 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:05.445370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-af0601d8-3625-4ce3-920d-1d34d7c59cdf req-00dce150-07a5-4536-b8e2-b4b166e9ff59 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:05.449462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:05.451411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:05.457594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:05.460794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:05.461670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:05.462314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:05.463513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:05.464226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:05.464864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:05.471032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-af0601d8-3625-4ce3-920d-1d34d7c59cdf req-00dce150-07a5-4536-b8e2-b4b166e9ff59 service nova] Creating event network-vif-plugged:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:24:05.476974 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-af0601d8-3625-4ce3-920d-1d34d7c59cdf req-00dce150-07a5-4536-b8e2-b4b166e9ff59 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052024 Aug 29 19:24:05.477590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 235/468] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:05.666796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:05.675581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:05.680711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:05.687086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5b011ff9-ed3a-49a8-bc68-bcbef6c46ebb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.241851 Aug 29 19:24:05.687666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 234/469] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:05 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:06.718494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:06.719478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:06.726822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:06.727290 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:06.727797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:06.728525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:06.728980 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:06.729408 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:06.865352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:06.874034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:06.875472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:06.876655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-02ac3da0-5ae2-4336-82d7-01c2435bc175 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.164603 Aug 29 19:24:06.877209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 236/470] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:06 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:07.899988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:07.900583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:07.907709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:07.908226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:07.908658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:07.909359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:07.909813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:07.910262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:08.047166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:08.055922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:08.057345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:08.058502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-06f3090c-9399-4ae9-a45a-cac3a9aa28ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.162941 Aug 29 19:24:08.059651 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 235/471] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:07 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:24:08.960203 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80acf6f9-b210-4db2-8a1e-9a77004ac4cf"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:08.963376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:08.984417 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:08.984999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:08.985520 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:08.986587 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:08.987129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:08.987615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:09.082212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:09.083203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:09.097640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:09.098153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:09.098602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:09.099483 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:09.101373 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:09.102253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:09.618645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:09.626674 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:09.628378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:09.631801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-126518eb-f67e-4b11-8812-fe56a36e27f8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.551822 Aug 29 19:24:09.631801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 236/472] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:09 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:24:10.638626 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c8a66b05-4fcc-44fa-8f38-66a85496a58e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.697470 Aug 29 19:24:10.639734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 237/473] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:24:08 2022] POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-volume_attachments => generated 194 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:10.666303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:10.667495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:10.679542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:10.680498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:10.681428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:10.683100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:10.684162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:10.685045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:10.844619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:10.854563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:10.862020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:10.863240 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-22e7c7bc-6eb3-44bb-a4d6-46a43e5328fa tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.207710 Aug 29 19:24:10.864005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 237/474] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:10 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:11.889944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:11.890676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:11.900226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:11.900226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:11.900226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:11.900226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:11.900687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:11.900687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:12.045119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:12.054242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:12.055680 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:12.056875 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-dbbba079-9e24-4b48-ba61-d19f1b3837ce tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.173625 Aug 29 19:24:12.057426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 238/475] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:11 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:13.081130 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:13.081753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:13.087808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:13.088265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:13.088698 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:13.089390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:13.089847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:13.090266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:13.242255 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:13.251977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:13.253468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:13.254656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-13e0f344-7a31-4885-8be1-e8781de10575 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1807 microversion: 2.20 time: 0.177580 Aug 29 19:24:13.255217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 238/476] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:13 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:14.278850 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:14.279478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:14.286445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:14.286864 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:14.287492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:14.288426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:14.288900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:14.289323 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:14.428708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:14.438437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:14.439976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:14.441079 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7e8aa4c5-8303-45dc-84f1-d552db654669 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1794 microversion: 2.20 time: 0.166357 Aug 29 19:24:14.441904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 239/477] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:24:14 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:24:19.296974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6dde3f2a-43f3-4d3d-b8fb-3804b3ab1134 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:19.304195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6dde3f2a-43f3-4d3d-b8fb-3804b3ab1134 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:19.304941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6dde3f2a-43f3-4d3d-b8fb-3804b3ab1134 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:19.305380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6dde3f2a-43f3-4d3d-b8fb-3804b3ab1134 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:19.369247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6dde3f2a-43f3-4d3d-b8fb-3804b3ab1134 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Going to try to stop instance {{(pid=121336) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 19:24:19.543638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6dde3f2a-43f3-4d3d-b8fb-3804b3ab1134 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action" status: 202 len: 0 microversion: 2.1 time: 0.250329 Aug 29 19:24:19.544281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 239/478] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:24:19 2022] POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:24:19.552426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:19.553030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:19.560604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:19.561095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:19.561530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:19.562277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:19.562840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:19.563269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:19.566309 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:19.707165 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:19.716176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d3060ae2-57b1-4b73-a5f9-fde4874b2c16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.167484 Aug 29 19:24:19.716734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 240/479] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:19 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:20.738079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:20.738893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:20.745038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:20.746644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:20.746772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:20.747569 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:20.748115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:20.748602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:20.924316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:20.932898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-abaea5d2-a858-4d65-be84-010c9341e9fd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.199317 Aug 29 19:24:20.933753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 240/480] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:20 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:21.955071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:21.955892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:21.968488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:21.973399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:21.973399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:21.973399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:21.973399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:21.973789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:22.139580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:22.149677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b0bdf3f8-a2a9-4b29-960e-738b03b4c95f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.198967 Aug 29 19:24:22.150809 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 241/481] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:21 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:23.172755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:23.173399 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:23.179763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:23.180305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:23.180747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:23.181479 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:23.181940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:23.182385 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:23.378199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:23.387837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6f52f738-a70e-4976-8710-bfc3ada4f28f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.219024 Aug 29 19:24:23.388450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 241/482] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:23 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:24.325658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2045358051", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1637069204", "security_groups": [{"name": "tempest-secgroup-smoke-2052608907"}], "networks": [{"uuid": "61846dcf-6ba2-42f8-8fa7-d94ce6df1976"}], "block_device_mapping_v2": [{"uuid": "aaab4461-f9ea-4122-ba22-24e590ce380a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:24.411644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:24.412393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:24.419803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:24.420620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:24.421155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:24.422079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:24.422707 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:24.423136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:24.496114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] validate_networks() for [('61846dcf-6ba2-42f8-8fa7-d94ce6df1976', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:24:24.815340 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:24.829030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a574a5bc-1774-4ceb-a3f1-9d548028fb16 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.421135 Aug 29 19:24:24.829902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 242/483] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:24 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:24.943308 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=30 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:25.167485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:24:25.167918 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:24:25.168394 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:24:25.168804 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:24:25.169212 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:24:25.178169 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:25.178690 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:25.179067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:25.179789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:25.180291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:25.180715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:25.198066 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Getting quotas for project ce2ee7950a334c8888dae733cb698533. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:24:25.202504 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Getting quotas for user a111fd5f36324d75ac8ad55e762aeaca and project ce2ee7950a334c8888dae733cb698533. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:24:25.264727 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:24:25.266844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aaab4461-f9ea-4122-ba22-24e590ce380a',volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:24:25.740587 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1599cfb5-d65b-44af-a5e2-9768d4010aa4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.419315 Aug 29 19:24:25.741467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 242/484] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:24:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:24:25.755571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-da8d8da4-f497-4095-a567-d34d1e8ba314 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:25.756241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-da8d8da4-f497-4095-a567-d34d1e8ba314 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:25.774427 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:25.851247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:25.852112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:25.852803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-da8d8da4-f497-4095-a567-d34d1e8ba314 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:25.862171 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-da8d8da4-f497-4095-a567-d34d1e8ba314 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1089 microversion: 2.1 time: 0.110408 Aug 29 19:24:25.862606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:25.862973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 243/485] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:25 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1089 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:25.864374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:25.865030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:25.866513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:25.867161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:25.867815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:26.026837 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:26.036373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0de8e185-c9ea-4345-ae3c-d891c3b06cc0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.189515 Aug 29 19:24:26.037666 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 243/486] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:25 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:26.888683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fe2bb528-2f15-4bf6-9320-0fc8ad7fca39 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:26.892583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fe2bb528-2f15-4bf6-9320-0fc8ad7fca39 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:27.060292 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:27.060951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:27.068384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fe2bb528-2f15-4bf6-9320-0fc8ad7fca39 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:27.071972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:27.072844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:27.074357 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:27.075778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:27.076632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:27.077329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:27.083015 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fe2bb528-2f15-4bf6-9320-0fc8ad7fca39 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1089 microversion: 2.1 time: 0.202323 Aug 29 19:24:27.083988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 244/487] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:26 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1089 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:27.240624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:27.249918 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bc9811ef-ce7b-4b24-bfa7-8d041d190256 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.195335 Aug 29 19:24:27.250491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 244/488] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:27 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:28.106141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:28.107347 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:28.115262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:28.116218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:28.116858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:28.117585 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:28.118043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:28.118468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:28.194107 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:28.204500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c278ed00-0782-46e6-8bf8-9427e38ff9f4 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1187 microversion: 2.1 time: 0.103421 Aug 29 19:24:28.205452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 245/489] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:28 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:28.275581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:28.279149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:28.297885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:28.298474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:28.299000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:28.301437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:28.301916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:28.302354 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:28.597572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:28.610742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d98c10e4-c8d6-4c91-9dd1-eb86cc65a486 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.342475 Aug 29 19:24:28.612946 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 245/490] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:28 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:29.228789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:29.229411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:29.238116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:29.238611 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:29.239093 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:29.240087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:29.241084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:29.241664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:29.358590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:29.367500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d0e3fe0e-5b60-454e-b24f-0ddcda953b17 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1195 microversion: 2.1 time: 0.143655 Aug 29 19:24:29.368445 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 246/491] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:29 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1195 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:29.640681 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:29.643620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:29.650704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:29.651201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:29.651660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:29.652573 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:29.653257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:29.653838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:30.032576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:30.048332 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6fa673cb-ccad-45cc-988e-ee1537075a6f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.414961 Aug 29 19:24:30.060522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 246/492] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:29 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:30.390580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:30.391188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:30.399013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:30.399701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:30.400542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:30.401687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:30.402925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:30.403498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:30.736759 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:30.744890 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8ca823a9-754c-4434-898d-6bdcc10629f7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1273 microversion: 2.1 time: 0.358905 Aug 29 19:24:30.746384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 247/493] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:30 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1273 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:31.072646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:31.073267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:31.080022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:31.080860 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:31.081505 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:31.082348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:31.082915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:31.083450 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:31.627493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:31.636992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3bc8d45b-ab8c-4426-91dc-f90500777033 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.567985 Aug 29 19:24:31.646881 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 247/494] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:31 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:31.768277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:31.768893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:31.781523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:31.782063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:31.782798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:31.783254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:31.783718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:31.790567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:31.795752 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:32.061917 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:32.069748 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b4d6be5c-b4b6-4d5a-bc4e-70715c602ee1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.305236 Aug 29 19:24:32.070431 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 248/495] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:31 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:32.396642 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-2fa9f149-946f-4c70-9f0d-49cbfd74ce70 req-783b8946-2e22-4fb1-8830-0946f8a4724a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:32.410825 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-2fa9f149-946f-4c70-9f0d-49cbfd74ce70 req-783b8946-2e22-4fb1-8830-0946f8a4724a service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:32.411346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-2fa9f149-946f-4c70-9f0d-49cbfd74ce70 req-783b8946-2e22-4fb1-8830-0946f8a4724a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:32.412319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-2fa9f149-946f-4c70-9f0d-49cbfd74ce70 req-783b8946-2e22-4fb1-8830-0946f8a4724a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:32.432931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-2fa9f149-946f-4c70-9f0d-49cbfd74ce70 req-783b8946-2e22-4fb1-8830-0946f8a4724a service nova] Creating event network-changed:d83b4120-aa4e-498d-b627-3c7df3272a2d for instance fdf00998-1f50-44db-b548-fe6bc04f5742 on hv-cinder-85501 Aug 29 19:24:32.440516 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-2fa9f149-946f-4c70-9f0d-49cbfd74ce70 req-783b8946-2e22-4fb1-8830-0946f8a4724a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047396 Aug 29 19:24:32.441413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 248/496] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:32.665514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:32.666122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:32.672494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:32.673170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:32.675497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:32.676631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:32.677280 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:32.677709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:32.922227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:32.932017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-896ace39-f83a-4a30-baa6-1b67a53420bc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.270729 Aug 29 19:24:32.936260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 249/497] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:32 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:33.092666 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:33.093364 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:33.105423 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:33.108272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:33.108272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:33.117585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:33.118232 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:33.118812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:33.401463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:33.410775 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-788f652a-19c2-425a-a148-4707c828a7ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.321944 Aug 29 19:24:33.412032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 249/498] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:33 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:33.956032 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:33.956884 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:33.962928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:33.963411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:33.963840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:33.965957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:33.966088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:33.966501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:34.109019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:34.117916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-eb623784-ca85-4f58-9444-1c669ad00647 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.166762 Aug 29 19:24:34.118472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 250/499] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:33 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:34.437535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:34.438199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:34.446325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:34.447151 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:34.447729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:34.448979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:34.449433 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:34.449862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:34.618465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:34.629497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f262a880-77ec-4c12-8475-74aaacbb60f6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.201335 Aug 29 19:24:34.630146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 250/500] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:34 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:35.141030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:35.143836 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:35.149196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:35.150061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:35.150691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:35.152146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:35.152955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:35.153576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:35.310167 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:35.322798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-03b311ab-9ba6-4ac5-ab9d-40db6fdeec3c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.185617 Aug 29 19:24:35.323544 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 251/501] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:35 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:35.459723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c19494ff-db9d-4abb-91df-d031839725cb"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:35.462755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:35.466689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:35.475134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:35.482534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:35.483378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:35.485579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:35.495574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:35.495574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:35.495574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:35.655731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:35.655731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:35.678746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:35.679553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:35.683401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:35.685142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:35.685788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:35.687895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:35.866451 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:35.880365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-de6cdb69-266e-4ac9-9adb-27cd6a10324e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.233448 Aug 29 19:24:35.894635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 252/502] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:35 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:36.348327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:36.350957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:36.359588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:36.365076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:36.366088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:36.367823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:36.368568 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:36.371613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:36.414268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f60cf3bf-1201-49a2-af9f-82a86e8cb972 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.961547 Aug 29 19:24:36.415679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 251/503] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:24:35 2022] POST /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:36.553761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:36.563134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5d6dbc44-1047-4918-8e90-9c39b2858f74 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.221980 Aug 29 19:24:36.564588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 253/504] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:36 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:36.903600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:36.905038 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:36.911827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:36.912460 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:36.913000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:36.913837 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:36.914397 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:36.914890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:37.072196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:37.081002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-faba4a1e-9b95-492f-9958-75912bd3af4b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.182585 Aug 29 19:24:37.081590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 252/505] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:36 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:37.585834 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:37.586438 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:37.588261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:37.594121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:37.594609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:37.595041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:37.596060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:37.596684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:37.597106 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:37.748244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:37.758865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-578f01b2-76d3-4963-b6f9-ca18e27deedf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.176776 Aug 29 19:24:37.759570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 254/506] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:37 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:38.101796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:38.102635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:38.108944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:38.109434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:38.109869 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:38.110613 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:38.111314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:38.111962 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:38.273640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:38.283123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bb30cc98-b7c1-4591-9840-9122c963ed11 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.185208 Aug 29 19:24:38.284699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 253/507] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:38 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:38.783780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:38.784764 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:38.792803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:38.793290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:38.793746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:38.794549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:38.794995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:38.795412 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:38.944416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:38.958492 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fe952136-3668-43fc-8754-5894e9667fdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.180170 Aug 29 19:24:38.959337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 255/508] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:38 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:39.310635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:39.311842 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:39.319164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:39.320002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:39.320661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:39.321601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:39.322264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:39.322913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:39.504784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:39.515913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a3fd3ddc-55f8-4cf5-a407-48ca57800784 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.210978 Aug 29 19:24:39.516925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 254/509] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:39 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:39.984259 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:39.985497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:39.999624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:40.000233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:40.000679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:40.001419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:40.001882 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:40.002313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:40.155283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:40.165084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d5b303d1-63ca-47fb-bbc6-de0e671c13b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1723 microversion: 2.1 time: 0.184201 Aug 29 19:24:40.165697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 256/510] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:39 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:40.537221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:40.537987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:40.546392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:40.546392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:40.546392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:40.546392 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:40.546818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:40.547009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:40.695779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:40.705826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e75f8eed-75f2-4c1a-a4e5-655fc9c710d7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.172509 Aug 29 19:24:40.708672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 255/511] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:40 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:41.187244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:41.187872 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:41.194492 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.195199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.196241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:41.197315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.197928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.198819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:41.341271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:41.358014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6cb077fa-9a4a-4668-8e8f-1ab15bbed836 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1700 microversion: 2.1 time: 0.175267 Aug 29 19:24:41.358605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 257/512] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:41 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1700 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:41.379977 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2c70b944-877d-4e32-ab0f-7126a27d99fc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:41.390445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c70b944-877d-4e32-ab0f-7126a27d99fc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.390937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c70b944-877d-4e32-ab0f-7126a27d99fc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.391383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c70b944-877d-4e32-ab0f-7126a27d99fc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:41.456567 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2c70b944-877d-4e32-ab0f-7126a27d99fc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Going to try to start instance {{(pid=121337) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 19:24:41.461140 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:41.720456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2c70b944-877d-4e32-ab0f-7126a27d99fc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action" status: 202 len: 0 microversion: 2.1 time: 0.344031 Aug 29 19:24:41.722531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 256/513] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:24:41 2022] POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:24:41.730942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:41.736869 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:41.738113 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:41.748777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:41.752360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.753147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.754969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:41.755981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.758409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.759043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:41.762153 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.764795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.765250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:41.765977 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:41.766438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:41.766867 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:42.176993 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:42.177739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:42.185696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8c0054b0-f563-4710-a969-ce20dcdefa7b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.453169 Aug 29 19:24:42.199287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 257/514] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:41 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:42.199420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a3657579-c290-41bc-83de-de5d16b4dd4e tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1709 microversion: 2.1 time: 0.463883 Aug 29 19:24:42.209708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 258/515] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:41 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1709 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:43.216795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:43.224790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:43.225260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:43.225343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:43.225343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:43.225343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:43.225592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:43.225671 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:43.225752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:43.225752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:43.225905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:43.226259 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:43.226479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:43.226944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:43.227282 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:43.227414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:43.466600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:43.476381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9d4f45b1-3e26-44de-b3e2-12aeb368b8a2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1709 microversion: 2.1 time: 0.265572 Aug 29 19:24:43.490006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 259/516] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:43 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1709 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:43.490359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:43.494487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-41fdeb5a-a753-4c60-b4bc-1d72f016bb2b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.284136 Aug 29 19:24:43.495654 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 258/517] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:43 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:43.700765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-f6d447a3-9f94-4aef-a436-2eff278549ac req-efe76ded-7ad7-42c0-9493-576561092aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "name": "network-vif-plugged", "status": "completed", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:43.724251 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f6d447a3-9f94-4aef-a436-2eff278549ac req-efe76ded-7ad7-42c0-9493-576561092aaa service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:43.724251 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f6d447a3-9f94-4aef-a436-2eff278549ac req-efe76ded-7ad7-42c0-9493-576561092aaa service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:43.724251 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f6d447a3-9f94-4aef-a436-2eff278549ac req-efe76ded-7ad7-42c0-9493-576561092aaa service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:43.733582 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-f6d447a3-9f94-4aef-a436-2eff278549ac req-efe76ded-7ad7-42c0-9493-576561092aaa service nova] Creating event network-vif-plugged:d83b4120-aa4e-498d-b627-3c7df3272a2d for instance fdf00998-1f50-44db-b548-fe6bc04f5742 on hv-cinder-85501 Aug 29 19:24:43.747619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-f6d447a3-9f94-4aef-a436-2eff278549ac req-efe76ded-7ad7-42c0-9493-576561092aaa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050195 Aug 29 19:24:43.748439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 260/518] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:44.500180 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:44.500793 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:44.506869 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:44.507360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:44.507795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:44.508527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:44.508994 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:44.510999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:44.517334 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:44.518083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:44.526775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:44.527977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:44.528758 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:44.529668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:44.530385 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:44.530808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:44.733060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:44.737538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:44.742845 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-30b0f929-82da-4042-b856-ce784defa5a5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1713 microversion: 2.1 time: 0.246888 Aug 29 19:24:44.743422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 259/519] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:44 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1713 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:44.745957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5bcc21f7-b039-4ea5-ade7-2a7b0d8fdfa0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.233279 Aug 29 19:24:44.751770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 261/520] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:44 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:44.751905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9b27feed-cedd-423c-9d82-69fef5ef06d7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Action: 'create', calling method: .version_select at 0x7f1fde608e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-582808485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOya1mi0rGUzwDDnCWX+IcMdXc3JBAE4BWdciNLeIxQR+eVoy52rrMjgI3Zxenr/CGIjea+HrTJPRklmiBVIK5VnePdktgt2sejTW3wUnzAEXmN2FFcRrve/+iWPxPdInA=="}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:44.765694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-9b27feed-cedd-423c-9d82-69fef5ef06d7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Getting quotas for project fd9cf517497a40f6baebabe7bc3ea73f. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:24:44.771193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-9b27feed-cedd-423c-9d82-69fef5ef06d7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Getting quotas for user 1c994f449c0c45b3b04ba9c96d80a824 and project fd9cf517497a40f6baebabe7bc3ea73f. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:24:44.911279 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9b27feed-cedd-423c-9d82-69fef5ef06d7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.166185 Aug 29 19:24:44.911928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 260/521] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:24:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:44.963249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1611641401", "imageRef": "96762b41-77ec-4ffb-82cc-a598c18c9312", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-582808485", "networks": [{"uuid": "d6756f2d-114b-43b4-b8c7-a0731aa2bf70"}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:45.017717 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] validate_networks() for [('d6756f2d-114b-43b4-b8c7-a0731aa2bf70', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:24:45.138027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:45.140322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:45.146464 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.146943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.147657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.148569 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.149023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.149442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.173922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'flavor' on Instance uuid cec9ec5e-04e7-4ed4-9611-4a2bcecd198e {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:24:45.420585 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:24:45.421003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:24:45.421468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:24:45.421875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:24:45.422276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:24:45.431043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.431520 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.431981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.433215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.433666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.434086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.451601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Getting quotas for project fd9cf517497a40f6baebabe7bc3ea73f. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:24:45.455902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Getting quotas for user 1c994f449c0c45b3b04ba9c96d80a824 and project fd9cf517497a40f6baebabe7bc3ea73f. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:24:45.467038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:24:45.469289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='96762b41-77ec-4ffb-82cc-a598c18c9312',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:24:45.579881 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5785593d-d72c-45e2-ab6d-4bd970364d54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/action" status: 200 len: 32 microversion: 2.1 time: 0.446229 Aug 29 19:24:45.580536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 261/522] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:24:45 2022] POST /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:24:45.590324 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:45.595982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:45.597193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.597650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.598081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.598780 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.599366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.599670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.640079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6f508c23-f6b1-4dc8-9c66-68f7605f8b4e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680596 Aug 29 19:24:45.641023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 262/523] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:24:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:24:45.651568 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-566f44ae-867d-4fe5-b6c2-3aa90263ca58 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:45.652220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-566f44ae-867d-4fe5-b6c2-3aa90263ca58 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:45.720796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-566f44ae-867d-4fe5-b6c2-3aa90263ca58 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:45.728501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-566f44ae-867d-4fe5-b6c2-3aa90263ca58 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1258 microversion: 2.1 time: 0.080841 Aug 29 19:24:45.729104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 263/524] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:45 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:45.766520 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:45.771207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:45.771821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:45.776771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ec197fe5-c48f-4921-975c-0f1ac5c0629c tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.190470 Aug 29 19:24:45.777689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 262/525] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:45 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:45.788243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.788243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.788243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.788243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:45.789185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:45.789185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:45.955791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:45.963989 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0f11bb97-514d-4fde-be22-c097d5e9da50 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1261 microversion: 2.1 time: 0.196778 Aug 29 19:24:45.964562 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 264/526] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:45 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:46.749536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2005816b-c095-4b72-99ce-2b82706db14a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:46.750132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2005816b-c095-4b72-99ce-2b82706db14a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:46.802951 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:46.803533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:46.812895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:46.813399 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:46.814087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:46.814988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:46.815808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:46.816271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:46.831197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2005816b-c095-4b72-99ce-2b82706db14a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:46.838904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2005816b-c095-4b72-99ce-2b82706db14a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1258 microversion: 2.1 time: 0.092576 Aug 29 19:24:46.839493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 263/527] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:46 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1258 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:46.984671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:46.986072 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:46.993746 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:46.996038 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:46.996500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:46.997226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:46.997878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:46.998310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:47.049054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:47.058415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-dbbcc4c7-c993-4bd5-944e-a56c3353fb37 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.259306 Aug 29 19:24:47.062494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 265/528] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:46 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:47.213887 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:47.223544 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fa95bfbd-0f1a-4818-aa96-fad4e762c41d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1446 microversion: 2.1 time: 0.243021 Aug 29 19:24:47.224260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 264/529] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:46 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:47.245674 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:47.246316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:47.252594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:47.253126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:47.253511 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:47.254218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:47.254674 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:47.255095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:47.390244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:47.398945 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cb0ac457-c590-46c9-af4c-337950140241 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1446 microversion: 2.1 time: 0.157419 Aug 29 19:24:47.399157 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 266/530] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:47 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:47.860132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:47.860856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:47.867890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:47.868456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:47.868949 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:47.870185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:47.870706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:47.871229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:47.940840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:47.949453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-98ed3a92-5752-4f1c-96e9-ac04ca5d1495 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1310 microversion: 2.1 time: 0.093058 Aug 29 19:24:47.950590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 265/531] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:47 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:48.083285 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:48.083952 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:48.091453 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:48.092559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:48.093640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:48.094345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:48.094960 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:48.095603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:48.100309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:48.286352 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:48.295542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9e600e4c-6f0b-4064-ba09-d53a8d747553 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.218326 Aug 29 19:24:48.306303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 267/532] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:48 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:48.971171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:48.971828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:48.979953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:48.980712 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:48.981325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:48.982280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:48.982877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:48.983337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:49.105013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:49.115528 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d7a24741-4371-43d5-8908-a8183c3c82d9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1328 microversion: 2.1 time: 0.148270 Aug 29 19:24:49.116738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 266/533] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:48 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:49.316840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:49.317455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:49.323418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:49.323932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:49.324737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:49.325455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:49.325910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:49.326330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:49.719401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:49.729632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9de3fb70-e0df-44c9-8402-1c9487a5512a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.416026 Aug 29 19:24:49.746068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 268/534] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:49 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:50.140876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:50.142633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:50.150601 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:50.152003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:50.152678 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:50.153498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:50.154064 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:50.154617 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:50.245984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:50.255844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-53b329c4-9e87-4e98-865c-c4c390fe3445 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1316 microversion: 2.1 time: 0.119171 Aug 29 19:24:50.257726 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 267/535] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:50 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1316 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:50.752196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:50.752989 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:50.759439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:50.759965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:50.761210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:50.762549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:50.762549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:50.762819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:51.077718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:51.082360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-050bfaba-e9c6-421a-855b-5194f7678635 req-a87ea1fb-66b4-4109-9c69-c6172b5768d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:24:51.102188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b7ed33ec-eaf8-4c02-9fbb-5646d7a57082 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.353868 Aug 29 19:24:51.102806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-050bfaba-e9c6-421a-855b-5194f7678635 req-a87ea1fb-66b4-4109-9c69-c6172b5768d2 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:51.103396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 269/536] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:50 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:51.103514 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-050bfaba-e9c6-421a-855b-5194f7678635 req-a87ea1fb-66b4-4109-9c69-c6172b5768d2 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:51.115363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-050bfaba-e9c6-421a-855b-5194f7678635 req-a87ea1fb-66b4-4109-9c69-c6172b5768d2 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:51.130674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-050bfaba-e9c6-421a-855b-5194f7678635 req-a87ea1fb-66b4-4109-9c69-c6172b5768d2 service nova] Creating event network-changed:d83b4120-aa4e-498d-b627-3c7df3272a2d for instance fdf00998-1f50-44db-b548-fe6bc04f5742 on hv-cinder-85501 Aug 29 19:24:51.137314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-050bfaba-e9c6-421a-855b-5194f7678635 req-a87ea1fb-66b4-4109-9c69-c6172b5768d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059976 Aug 29 19:24:51.141361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 268/537] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:24:51.278244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:51.278943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:51.285661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:51.286503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:51.287149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:51.288028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:51.288563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:51.289059 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:51.439757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:51.449932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c68b83cc-5dcb-40e4-a86b-4a20fb6f0ac1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.175527 Aug 29 19:24:51.451046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 270/538] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:51 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:52.126658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:52.127511 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:52.134147 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:52.136396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:52.137119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:52.138087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:52.138770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:52.139468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:52.290718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:52.302403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3c035601-3cf0-47c6-975c-d643f5ced63b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.178617 Aug 29 19:24:52.303424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 269/539] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:52 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:52.471522 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:52.472161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:52.478107 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:52.478589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:52.479631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:52.480346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:52.480802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:52.481220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:52.625418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:52.632994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-05deecbb-74f3-4ebd-93f5-4fcea56fccc7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.165389 Aug 29 19:24:52.633548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 271/540] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:52 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:53.325902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:53.325902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:53.332376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:53.332851 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:53.333332 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:53.335526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:53.336146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:53.336467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:53.475378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:53.484431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b63e58c0-0671-49f9-9e94-d45a824c9bf1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.163861 Aug 29 19:24:53.484988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 270/541] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:53 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:53.654792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:53.655319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:53.661710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:53.662186 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:53.662613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:53.663303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:53.663752 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:53.664201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:53.812554 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:53.820883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-496eefef-c687-4620-8c91-9d9718d93740 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.170670 Aug 29 19:24:53.821458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 272/542] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:53 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:54.506710 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:54.509179 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:54.519006 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.519893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.520587 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.521778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.522479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.523154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.635672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:54.636700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:54.642855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.643431 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.643965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.644734 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.645269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.645779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.671986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:54.686283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2cc97c81-a53e-485e-a32c-fe58b9799a5d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments/c62b25a1-172d-4168-b8e9-97ba22c3473f" status: 200 len: 194 microversion: 2.20 time: 0.054974 Aug 29 19:24:54.688250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 273/543] 10.222.0.62 () {60 vars in 1454 bytes} [Mon Aug 29 19:24:54 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments/c62b25a1-172d-4168-b8e9-97ba22c3473f => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:24:54.689194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-312942e8-ce63-47b2-98ed-02d4cad1eb7e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.186893 Aug 29 19:24:54.705275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 271/544] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:54 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:54.763581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:54.764035 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:54.770256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.770736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.771191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.771892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.772355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.772809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.844685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:54.845367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:54.851684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.852206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.852854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.853555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:54.855615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:54.856082 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:54.908691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lazy-loading 'services' on Instance uuid db903f97-8e2a-428c-a4d8-64321853b802 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:24:55.034163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:55.042477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bc290ea3-da29-47eb-b237-d05703e8cdd7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.201743 Aug 29 19:24:55.043046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 272/545] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:54 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:55.301303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3257f050-0637-41b9-9ba5-951b815e3651 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments/c62b25a1-172d-4168-b8e9-97ba22c3473f" status: 202 len: 0 microversion: 2.20 time: 0.541991 Aug 29 19:24:55.302068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 274/546] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Aug 29 19:24:54 2022] DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments/c62b25a1-172d-4168-b8e9-97ba22c3473f => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:24:55.314481 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:55.317906 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:55.320768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:55.328632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:55.332355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:55.332355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:55.332355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:55.332355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:55.332698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:55.336804 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:55.365420 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0635958c-2e24-4b73-bce4-e83c9d67e761 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058544 Aug 29 19:24:55.365965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 273/547] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:24:55 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:24:55.714596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:55.715951 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:55.717921 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:55.723183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:55.723751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:55.724217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:55.724926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:55.725381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:55.725808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:55.726261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=8 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:55.880495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:55.888733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e8bd5353-fe77-4b2d-b37b-f804d9e6f68f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.178374 Aug 29 19:24:55.889289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 275/548] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:55 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:24:56.063806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:56.064512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:56.073861 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:56.074353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:56.074845 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:56.075581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:56.076074 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:56.076504 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:56.225026 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:56.233820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ebf67fe6-5273-482d-805f-44dc44ebacdb tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.174435 Aug 29 19:24:56.236753 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 274/549] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:56 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:56.379687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:56.382093 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:56.388345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:56.388833 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:56.391391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:56.391391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:56.391391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:56.391391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:56.428596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cf17a058-0c5b-4ec4-ac37-673ca19cc337 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053852 Aug 29 19:24:56.429494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 276/550] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:24:56 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:24:56.914199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:56.914999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:56.921591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:56.923896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:56.924417 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:56.925069 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:56.925779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:56.926229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:56.926653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:57.182023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:57.182023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7b25cd3c-471c-4842-85fe-cf35b935fc85 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.209247 Aug 29 19:24:57.182023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 275/551] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:56 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:57.256776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:57.257680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:57.266616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:57.267147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:57.267584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:57.268389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:57.268877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:57.269332 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:57.419639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:57.427292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4a583e2f-c608-46e0-9ac0-a6edc2b98fb0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.174753 Aug 29 19:24:57.427882 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 277/552] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:57 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:57.441723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:57.443968 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:57.450728 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:57.451207 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:57.451636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:57.452361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:57.452810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:57.453228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:57.490283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cb839d93-df63-4298-abf2-27dd0ceeaee8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052538 Aug 29 19:24:57.496432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 276/553] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:24:57 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:24:58.198930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:58.199969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:58.206753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:58.208704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:58.209414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:58.210053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:58.210967 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:58.212380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:58.213099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:58.395345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:58.413605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5b59338b-bbe5-4449-bcc2-b545e3537a11 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.219069 Aug 29 19:24:58.414556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 278/554] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:58 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:58.450559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:58.451380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:58.458149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:58.458635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:58.459070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:58.459773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:58.460252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:58.460676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:58.508258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:58.508258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:58.518193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:58.518985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:58.519435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:58.520212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:58.520890 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:58.521398 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:58.571577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-eadf63c6-4061-41c0-9da3-db7e7a4444cd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071339 Aug 29 19:24:58.572944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 279/555] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:24:58 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:24:58.610452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:58.626965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ee57896e-57ca-47bc-8ca0-e9bcce50e4a7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.182420 Aug 29 19:24:58.627743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 277/556] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:58 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:59.436156 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:59.436759 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:59.443168 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:59.443646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:59.444111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:59.444798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:59.445245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:59.445662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:59.577969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:59.584963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:59.587088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9f527642-89b9-49cc-ad18-5baa1c5405f5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.155462 Aug 29 19:24:59.587384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:59.587953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 280/557] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:59 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:24:59.593860 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:59.594462 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:59.594902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:59.595914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:59.596577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:59.597048 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:59.628534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-648bdaa9-248e-465f-8434-4768bc171260 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047777 Aug 29 19:24:59.629304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 278/558] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:24:59 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:24:59.648711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:24:59.649325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:24:59.656383 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:59.656857 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:59.657291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:59.657984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:24:59.658440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:24:59.658865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:24:59.796123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:24:59.803875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f6dd21eb-7a53-4a55-ae30-41f4bc934702 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.159031 Aug 29 19:24:59.804481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 281/559] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:24:59 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:00.609151 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:00.609758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:00.616555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:00.617023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:00.617478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:00.618176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:00.618695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:00.619100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:00.641961 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:00.644781 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:00.656043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:00.657321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:00.657882 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:00.658884 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:00.659480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:00.660300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:00.696254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6ca8745d-507a-48a0-b209-cd639e70e9b2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057052 Aug 29 19:25:00.696254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 282/560] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:25:00 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:25:00.826579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:00.827221 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:00.833634 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:00.834126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:00.834560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:00.835262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:00.835717 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:00.836174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:00.840946 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:00.853300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:00.861986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3b1410ae-9f84-4d8d-8351-c319e9196197 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.256858 Aug 29 19:25:00.871956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 279/561] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:00 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:00.996002 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:01.003569 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-410077ba-5e8d-4b04-84b4-a9a739fe00e0 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.181376 Aug 29 19:25:01.004202 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 283/562] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:00 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:01.085080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-cc194782-8635-4145-ab53-3bc5d570afc9 req-4f56afab-4e66-4c26-b0b2-4cac1fc481af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:01.102359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-cc194782-8635-4145-ab53-3bc5d570afc9 req-4f56afab-4e66-4c26-b0b2-4cac1fc481af service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.106530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-cc194782-8635-4145-ab53-3bc5d570afc9 req-4f56afab-4e66-4c26-b0b2-4cac1fc481af service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.106530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-cc194782-8635-4145-ab53-3bc5d570afc9 req-4f56afab-4e66-4c26-b0b2-4cac1fc481af service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:01.115700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-cc194782-8635-4145-ab53-3bc5d570afc9 req-4f56afab-4e66-4c26-b0b2-4cac1fc481af service nova] Creating event network-changed:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:25:01.123309 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-cc194782-8635-4145-ab53-3bc5d570afc9 req-4f56afab-4e66-4c26-b0b2-4cac1fc481af service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042481 Aug 29 19:25:01.124284 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 280/563] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:01.707272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:01.709585 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:01.716302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.716775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.717200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:01.717888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.718361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.718774 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:01.747512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-47d79ba9-24a5-42d5-8c73-6486feb2ceb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044683 Aug 29 19:25:01.748099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 284/564] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:25:01 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:01.815113 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:01.815627 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:01.822835 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.823334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.823708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:01.824451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.824899 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.825350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:01.851118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:25:01.883063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:01.883832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:01.890572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.893147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.893147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:01.893147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:01.893147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:01.893553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:02.109859 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-74623a15-4bf2-4b73-96f2-5ee2858bd4eb tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 204 len: 0 microversion: 2.20 time: 0.299199 Aug 29 19:25:02.110365 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 281/565] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 19:25:01 2022] DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:25:02.119048 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:02.119874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:02.125971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:02.126459 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:02.126891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:02.127588 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:02.128073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:02.128498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:02.130369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:02.138956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-03da8490-4515-4a4c-b8b2-87418ecef648 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.259765 Aug 29 19:25:02.139532 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 285/566] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:01 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:02.153802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:02.154466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:02.160533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:02.163523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:02.163523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:02.164503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:02.165090 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:02.165615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:02.355477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:02.366997 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1025e866-4d85-42ad-8609-8979ec701a80 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.251350 Aug 29 19:25:02.366997 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 282/567] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:02 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:02.380495 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:02.394855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:02.395605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:02.396874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1fc219db-295e-4338-b539-30e452ff17d6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.247519 Aug 29 19:25:02.398087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 286/568] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:02 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:03.162919 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:03.163639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:03.170586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:03.171060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:03.171489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:03.172196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:03.172643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:03.173061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:03.304529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:03.312935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-37e4eb07-679b-4bd8-b9e0-c2868ea22543 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.155821 Aug 29 19:25:03.313498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 283/569] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:03 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:03.387808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:03.388435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:03.394612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:03.395378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:03.395526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:03.396264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:03.396721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:03.397140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:03.420788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:03.421380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:03.427293 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:03.427771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:03.428243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:03.428931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:03.429378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:03.429800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:03.598136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:03.606456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-114a7bd4-5c88-46e3-aa5b-c86d44ebf09c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.222677 Aug 29 19:25:03.607023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 287/570] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:03 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:03.639496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:03.647477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:03.648932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:03.650071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-551df59a-e8a4-498b-9462-4d3dc1b4bf4b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.233650 Aug 29 19:25:03.651200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 284/571] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:03 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:04.334636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:04.335154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:04.341732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:04.342210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:04.342636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:04.343317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:04.343763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:04.344281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:04.472718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:04.481464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b8f218e2-fe15-403f-88f6-c7f121f5dff4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.150890 Aug 29 19:25:04.482017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 288/572] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:04 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:04.626817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:04.627373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:04.633788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:04.634271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:04.635216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:04.635933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:04.636386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:04.636818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:04.674026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:04.674666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:04.680775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:04.681260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:04.681698 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:04.682403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:04.682854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:04.683277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:04.820130 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:04.828327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1c3570e8-dbee-4b73-908a-66d1b4d17f9a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.205459 Aug 29 19:25:04.828894 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 285/573] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:04 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:04.843878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:04.852232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:04.853702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:04.854848 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4ac1d83c-e1d1-43db-bb23-e11ac17fcf95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1722 microversion: 2.20 time: 0.184664 Aug 29 19:25:04.855392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 289/574] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:04 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:05.502607 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:05.503207 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:05.509100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:05.509645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:05.510075 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:05.510755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:05.511200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:05.511619 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:05.757301 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:05.766142 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-84ee6590-2b63-451c-a864-1cbdecf4ea3f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.267339 Aug 29 19:25:05.766717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 286/575] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:05 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:05.850281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:05.851034 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:05.858195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:05.858683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:05.859348 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:05.860301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:05.860964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:05.861693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:05.878501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:05.879023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:05.887520 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:05.890449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:05.891197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:05.891961 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:05.892494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:05.895142 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:06.018478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:06.035789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:06.038300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:06.040152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d347fec1-be74-4cf8-be20-3ddb583063f0 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1654 microversion: 2.20 time: 0.165236 Aug 29 19:25:06.040755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 287/576] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:05 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:06.052631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-e3b8614d-3489-4dfa-88b9-dc848cd04133 req-eb1aeeed-cdee-4229-85cf-58b3101d1602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db903f97-8e2a-428c-a4d8-64321853b802", "name": "network-vif-deleted", "tag": "dbaf274a-6e24-41f4-9cb8-b4e9f89e6415"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:06.077027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e3b8614d-3489-4dfa-88b9-dc848cd04133 req-eb1aeeed-cdee-4229-85cf-58b3101d1602 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:06.082367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e3b8614d-3489-4dfa-88b9-dc848cd04133 req-eb1aeeed-cdee-4229-85cf-58b3101d1602 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:06.082367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e3b8614d-3489-4dfa-88b9-dc848cd04133 req-eb1aeeed-cdee-4229-85cf-58b3101d1602 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:06.095112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-e3b8614d-3489-4dfa-88b9-dc848cd04133 req-eb1aeeed-cdee-4229-85cf-58b3101d1602 service nova] Creating event network-vif-deleted:dbaf274a-6e24-41f4-9cb8-b4e9f89e6415 for instance db903f97-8e2a-428c-a4d8-64321853b802 on hv-cinder-85501 Aug 29 19:25:06.100311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-e3b8614d-3489-4dfa-88b9-dc848cd04133 req-eb1aeeed-cdee-4229-85cf-58b3101d1602 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055901 Aug 29 19:25:06.101646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 288/577] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:06.117332 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:06.126938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-85176445-ea6c-4b89-a2e0-fa88ea233d11 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.280668 Aug 29 19:25:06.127970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 290/578] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:05 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:06.789665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:06.790366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:06.799299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:06.800307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:06.800963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:06.802057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:06.802807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:06.803441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:06.821771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:06.948304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:06.956948 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-63d6fdc9-79a4-48eb-b48b-27283e1fde4b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.171836 Aug 29 19:25:06.957473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 289/579] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:06 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:07.088471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:07.089227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:07.096760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:07.097261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:07.097694 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:07.098725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:07.099533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:07.100177 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:07.138687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:07.139269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:07.139978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:07.140550 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lazy-loading 'fault' on Instance uuid db903f97-8e2a-428c-a4d8-64321853b802 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:25:07.151090 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:07.152116 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:07.161282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:07.162073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:07.162789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:07.163967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:07.164636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:07.167893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:07.204122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:07.214922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:07.216920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:07.218095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c23f31a9-8fea-43ac-aa5e-b87d717d1eb8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 200 len: 1370 microversion: 2.20 time: 0.133500 Aug 29 19:25:07.218888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 291/580] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:07 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 1370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:07.316176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:07.323910 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-26518383-a17b-40ed-adcc-84a435e99114 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.177641 Aug 29 19:25:07.324546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 290/581] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:07 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:07.866806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-b85e038d-4e20-453e-b4e8-15bdbb02a3f0 req-90ac9db2-f907-4655-a68a-414a11612eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "name": "network-vif-plugged", "status": "completed", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:07.876923 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b85e038d-4e20-453e-b4e8-15bdbb02a3f0 req-90ac9db2-f907-4655-a68a-414a11612eab service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:07.877527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b85e038d-4e20-453e-b4e8-15bdbb02a3f0 req-90ac9db2-f907-4655-a68a-414a11612eab service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:07.877958 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b85e038d-4e20-453e-b4e8-15bdbb02a3f0 req-90ac9db2-f907-4655-a68a-414a11612eab service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:07.891262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-b85e038d-4e20-453e-b4e8-15bdbb02a3f0 req-90ac9db2-f907-4655-a68a-414a11612eab service nova] Creating event network-vif-plugged:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:25:07.896687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-b85e038d-4e20-453e-b4e8-15bdbb02a3f0 req-90ac9db2-f907-4655-a68a-414a11612eab service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033818 Aug 29 19:25:07.901341 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 292/582] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:07.981195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:07.981924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:08.007245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:08.007744 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:08.008226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:08.008959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:08.010698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:08.011465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:08.159419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:08.168366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c7ff7084-b3e6-4c51-9a5c-cd89afe65bc0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.193950 Aug 29 19:25:08.168932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 291/583] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:07 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:08.247203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:08.248331 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:08.255176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:08.255802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:08.256331 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:08.257324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:08.257804 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:08.258269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:08.273666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] HTTP exception thrown: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Request method failure captured: Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 HTTP/1.1 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGSUc4-2cnOcOgL1RsIYABYhQVFu3inGp8AxasWz0YMbiFhcn03mzFiRIKww6B2VQ5HYtJI-jeIeSyMCOwc1uC9WDSzq-oVdPI9MrfMM0wa7yjNheU7X3rgHtum0JK53BSSHLkcMBbq5lrio9LIDKROyGYirdi5Zkpa_4vB2uKOD1U Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:25:08.275593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de427c8638c049d3ad809158b0ccc0d2"}]}] Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 74bfde91bf944824bdae8207641a08b7 Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:25:08.277963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'db903f97-8e2a-428c-a4d8-64321853b802'} Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:25:08.279010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:25:08.280320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:25:08.281933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Returning 404 to user: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:25:08.281933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7e8c57a8-e9ed-4cd6-afff-7fd784da278e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 404 len: 111 microversion: 2.20 time: 0.034843 Aug 29 19:25:08.281933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 293/584] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:08 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:25:08.286441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b4d05c21-a3b3-4dbe-91dd-c2d3d3e0951d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '.version_select at 0x7f1fde4f9dc0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:08.345535 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:08.346147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:08.352308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:08.354363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:08.354363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:08.354628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:08.354911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:08.355353 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:08.404953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b4d05c21-a3b3-4dbe-91dd-c2d3d3e0951d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682815149" status: 204 len: 0 microversion: 2.20 time: 0.122283 Aug 29 19:25:08.411822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 292/585] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 19:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682815149 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:25:08.487664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:08.496316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-78998a12-8019-4e00-8004-9d95009063c4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.155083 Aug 29 19:25:08.496880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 294/586] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:08 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:09.190227 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:09.191498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:09.199024 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:09.204574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:09.204574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:09.204574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:09.204574 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:09.205160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:09.245679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-44fe7a97-eef7-445a-a552-09197bf614b1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'create', calling method: .version_select at 0x7f1fde90ef70>, body: {"keypair": {"name": "tempest-keypair-1599461889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcFWK0zg6gGzZukz/R8soxJATSzZEFuqjarZ2BAfxu3ueFgt/BZ0yR8purGboe14/8Z1h8CQQ67CRDP/HckqkE0zwgDhD7v3EfzL5Z/ywe2sBQuWpDP31JEdxh2+Y8F5w=="}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:09.261731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-44fe7a97-eef7-445a-a552-09197bf614b1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for project de427c8638c049d3ad809158b0ccc0d2. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:25:09.265687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-44fe7a97-eef7-445a-a552-09197bf614b1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for user 74bfde91bf944824bdae8207641a08b7 and project de427c8638c049d3ad809158b0ccc0d2. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:25:09.338699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:09.347898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-44fe7a97-eef7-445a-a552-09197bf614b1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.107074 Aug 29 19:25:09.348129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-50ed4c32-9b8b-44ac-b4c4-e2c729e51c0f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.161788 Aug 29 19:25:09.348801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 295/587] 10.222.0.62 () {62 vars in 1200 bytes} [Mon Aug 29 19:25:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 19:25:09.348925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 293/588] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:09 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:09.516562 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:09.517181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:09.523170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:09.523637 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:09.524109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:09.525451 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:09.525883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:09.526307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:09.669931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:09.677559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d4dce9fb-7315-4dfc-8f23-1a413918956a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1358 microversion: 2.1 time: 0.165012 Aug 29 19:25:09.678120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 296/589] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:09 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:10.370492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:10.371196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:10.377465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:10.377947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:10.378384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:10.379070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:10.379519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:10.379971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:10.514226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:10.523277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8e59f45c-3cb9-43f4-aa05-af1f5b6a13d8 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.157084 Aug 29 19:25:10.523882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 294/590] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:10 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:10.697854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:10.698471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:10.705469 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:10.706068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:10.706582 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:10.707295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:10.707820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:10.713242 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:10.838504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:10.846173 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2fdba576-7b30-4ed2-adac-907a53fa0906 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1548 microversion: 2.1 time: 0.152191 Aug 29 19:25:10.846835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 297/591] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:10 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:10.867103 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:10.867716 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:10.874267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:10.874751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:10.875186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:10.875909 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:10.876347 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:10.876848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.014941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:11.023044 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-efd13742-571b-4b52-8cfb-cbacda9bc84e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1548 microversion: 2.1 time: 0.159581 Aug 29 19:25:11.023659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 295/592] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:10 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:11.043740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:11.048660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:11.052825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Searching by: {'deleted': False, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f'} {{(pid=121336) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 19:25:11.056221 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:11.056704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:11.057142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.057861 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:11.058356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:11.058776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.148512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.multi_cell_list [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121336) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 19:25:11.244856 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-419ebb82-dc7a-4368-bd89-319536b325f8 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205394 Aug 29 19:25:11.245457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 298/593] 10.222.0.62 () {58 vars in 1125 bytes} [Mon Aug 29 19:25:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:11.257017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:11.259969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:11.264466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:11.265060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:11.265503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.266240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:11.266698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:11.267132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.413615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:11.422393 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-447a31c1-1e54-4eb8-bc14-2a586fa491c7 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1548 microversion: 2.1 time: 0.169271 Aug 29 19:25:11.423681 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 296/594] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:11 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:11.545938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:11.546734 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:11.553184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:11.553672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:11.554111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.554818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:11.555271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:11.555691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:11.701183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:11.709296 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1139826675", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77442b81-83b9-4ea8-a1cc-4b658ab1760b"}], "security_groups": [{"name": "tempest-securitygroup--77146302"}], "key_name": "tempest-keypair-1599461889", "user_data": "}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:11.710088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bd8d8912-b447-4f3e-8007-ea4835c95f71 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.168220 Aug 29 19:25:11.710728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 299/595] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:11 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:11.812236 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] validate_networks() for [('77442b81-83b9-4ea8-a1cc-4b658ab1760b', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:25:12.198058 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:25:12.198486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:25:12.199012 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:25:12.199416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:25:12.200019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:25:12.210909 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:12.211465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:12.211924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:12.213348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:12.213795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:12.214214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:12.236067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for project de427c8638c049d3ad809158b0ccc0d2. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:25:12.240449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Getting quotas for user 74bfde91bf944824bdae8207641a08b7 and project de427c8638c049d3ad809158b0ccc0d2. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:25:12.251751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:25:12.254046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:25:12.405714 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f9ff012b-f7d5-401d-bf32-c0b09cd6ba8f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.700602 Aug 29 19:25:12.406363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 297/596] 10.222.0.62 () {62 vars in 1188 bytes} [Mon Aug 29 19:25:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 19:25:12.417411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2211db30-13b7-46e2-9658-134ebc37d792 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:12.418018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2211db30-13b7-46e2-9658-134ebc37d792 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:12.473708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2211db30-13b7-46e2-9658-134ebc37d792 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:12.481273 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2211db30-13b7-46e2-9658-134ebc37d792 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:12.486761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2211db30-13b7-46e2-9658-134ebc37d792 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:12.486761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2211db30-13b7-46e2-9658-134ebc37d792 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1282 microversion: 2.20 time: 0.070485 Aug 29 19:25:12.486761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 300/597] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:12 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:12.731066 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:12.731670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:12.738448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:12.738925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:12.739356 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:12.740083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:12.740534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:12.740952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:13.149177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:13.158000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7ce8d48a-de2c-4190-99ff-23d2c3ba5af7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1733 microversion: 2.1 time: 0.430823 Aug 29 19:25:13.158559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 298/598] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:12 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1733 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:13.467755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42a36527-0349-4aae-9b94-5727890828d0"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:13.470182 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:13.476177 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:13.476656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:13.477087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:13.477772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:13.478227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:13.478644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:13.507243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:13.507888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:13.515567 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:13.516101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:13.516550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:13.517481 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:13.517939 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:13.518914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:13.583348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:13.591767 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:13.593469 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:13.594614 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ebadb1d5-0eaf-48fd-9e4a-da6364a00777 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1286 microversion: 2.20 time: 0.091486 Aug 29 19:25:13.595171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 299/599] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:13 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:13.739019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:14.178662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:14.179268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:14.185471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.185953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.186390 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.187087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.187545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.188032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.333519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:14.342940 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-34d004b4-2465-4aaf-8738-e14dc9658c4d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1713 microversion: 2.1 time: 0.168214 Aug 29 19:25:14.343699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 300/600] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:14 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:14.427724 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9928480f-f78b-471f-85c0-e3207fa4815e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963805 Aug 29 19:25:14.428454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 301/601] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:25:13 2022] POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments => generated 194 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:14.464002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:14.464650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:14.470622 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.471101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.471533 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.472296 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.472746 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.473195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.600436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] HTTP exception thrown: Cannot 'detach_volume' instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e while it is in vm_state rescued Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Request method failure captured: Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments/c19494ff-db9d-4abb-91df-d031839725cb HTTP/1.1 Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGS7CeGZR4ahpSfByWIi7V0_wyW0sqlGbLKlWF5vh5AJwoiDEtOq5ubLUNqY19BiRcPpHzC6vqtLPi4PwMLsDB1Ioag7GifYTvppdhAFzucgg0mexKP_jbzVEfLmM0Tn5sBkW53pxMlGw35Y4z2-pccig1PgZWE4ogttXsGlxTGhPA Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:25:14.602027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fec9a23227784d23ba703719c785e413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fec9a23227784d23ba703719c785e413"}]}] Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: bd993c0493d447cb9b02e424a28e24bc Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:25:14.603646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Cannot 'detach_volume' instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e while it is in vm_state rescued Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'server_id': 'cec9ec5e-04e7-4ed4-9611-4a2bcecd198e', 'id': 'c19494ff-db9d-4abb-91df-d031839725cb'} Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:25:14.604359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e while it is in vm_state rescued Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e while it is in vm_state rescued Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:25:14.605655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Returning 409 to user: Cannot 'detach_volume' instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e while it is in vm_state rescued {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:25:14.606897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4bb950bf-60d0-4ad4-b313-80ea67ec0825 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments/c19494ff-db9d-4abb-91df-d031839725cb" status: 409 len: 152 microversion: 2.1 time: 0.144666 Aug 29 19:25:14.606897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 301/602] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:25:14 2022] DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments/c19494ff-db9d-4abb-91df-d031839725cb => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:25:14.613510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:14.614205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:14.617761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:14.618416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:14.620970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.621514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.622199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.622902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.623353 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.623777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.625096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.625589 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.626056 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.626762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.627349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.627640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.693443 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:14.702038 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:14.703461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:14.704584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-38de3365-b5e3-42d7-aef9-ec4193497950 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1334 microversion: 2.20 time: 0.090583 Aug 29 19:25:14.705137 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 302/603] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:14 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:14.930790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6f248de7-722f-42e9-ba53-887cc432664a tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "POST /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/action" status: 202 len: 0 microversion: 2.1 time: 0.321782 Aug 29 19:25:14.934757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 302/604] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:25:14 2022] POST /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:25:14.940339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:14.940981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:14.949955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.950535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.950980 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:14.951707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:14.952237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:14.952688 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:15.171922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:15.181662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-409f0a45-ac9e-44a1-b1f1-76df5b958e48 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1721 microversion: 2.1 time: 0.245091 Aug 29 19:25:15.182931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 303/605] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:14 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:15.730754 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:15.732148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:15.739097 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:15.739799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:15.740267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:15.744419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:15.744935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:15.745372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:15.816268 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:15.825743 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:15.827480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:15.828793 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3fc76a8e-191c-45c6-8437-e24e159b1d95 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1340 microversion: 2.20 time: 0.102499 Aug 29 19:25:15.830408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 303/606] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:15 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:16.203563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:16.204202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:16.210729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:16.211209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:16.211645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:16.212508 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:16.213019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:16.213449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:16.344350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:16.353068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-43daa5b3-3ebf-49c4-afca-43bc3a394957 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1721 microversion: 2.1 time: 0.153717 Aug 29 19:25:16.353626 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 304/607] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:16 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:16.853504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:16.854131 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:16.860579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:16.861091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:16.861788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:16.862468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:16.863042 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:16.863433 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:16.998916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:17.007305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:17.008807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:17.010497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-866df5ec-c62b-411a-b594-98125839d953 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.160470 Aug 29 19:25:17.011054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 304/608] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:16 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:17.375257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:17.375878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:17.382551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:17.383063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:17.383505 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:17.384223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:17.384679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:17.385105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:17.585870 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:17.594030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-18d44663-971a-4958-ba2c-f5aca19190a1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1721 microversion: 2.1 time: 0.222696 Aug 29 19:25:17.594595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 305/609] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:17 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:18.032594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:18.033193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:18.039795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.041270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.041270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.041502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.041953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.042367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.266428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:18.276106 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:18.277597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:18.278698 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4adde6ed-c965-4b90-9ae0-ed588f4edd25 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.250083 Aug 29 19:25:18.279249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 305/610] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:18 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:18.436471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-14f9d1ed-6f2d-49e9-86aa-6063a9c62217 req-a281290c-5995-4e4e-a8b9-b40d8ae5ca81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:18.447837 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-14f9d1ed-6f2d-49e9-86aa-6063a9c62217 req-a281290c-5995-4e4e-a8b9-b40d8ae5ca81 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.448350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-14f9d1ed-6f2d-49e9-86aa-6063a9c62217 req-a281290c-5995-4e4e-a8b9-b40d8ae5ca81 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.448776 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-14f9d1ed-6f2d-49e9-86aa-6063a9c62217 req-a281290c-5995-4e4e-a8b9-b40d8ae5ca81 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.460798 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-14f9d1ed-6f2d-49e9-86aa-6063a9c62217 req-a281290c-5995-4e4e-a8b9-b40d8ae5ca81 service nova] Creating event network-changed:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:25:18.466407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-14f9d1ed-6f2d-49e9-86aa-6063a9c62217 req-a281290c-5995-4e4e-a8b9-b40d8ae5ca81 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035320 Aug 29 19:25:18.467061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 306/611] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:18.616210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:18.616819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:18.623253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.623743 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.624223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.624912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.625363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.625785 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.836100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:18.844330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bdb52198-d413-4c8a-8348-a311f11bee5f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1727 microversion: 2.1 time: 0.232029 Aug 29 19:25:18.844909 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 306/612] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:18 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:18.866123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:18.866867 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:18.873711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.874268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.874704 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.875396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:18.875868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:18.876299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:18.994621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c35362a6-b6e5-4a05-a001-338d65f599d5 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127404 Aug 29 19:25:18.994621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 307/613] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:25:18 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:19.301372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:19.302079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:19.309064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:19.309545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:19.309974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:19.310670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:19.311117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:19.311536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:19.622474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:19.630953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:19.632434 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:19.633702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-edb86221-59bf-4fe7-8f30-3e1c97f54476 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.336324 Aug 29 19:25:19.634756 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 307/614] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:19 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:20.483705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec9ec5e-04e7-4ed4-9611-4a2bcecd198e", "tag": "38405fa8-e5ca-4cb4-b875-6558d2f3759b"}, {"name": "network-changed", "server_uuid": "cec9ec5e-04e7-4ed4-9611-4a2bcecd198e", "tag": "38405fa8-e5ca-4cb4-b875-6558d2f3759b"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:20.494060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:20.494592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:20.494958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:20.508480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] Creating event network-changed:38405fa8-e5ca-4cb4-b875-6558d2f3759b for instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e on hv-cinder-85501 Aug 29 19:25:20.509588 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] Creating event network-changed:38405fa8-e5ca-4cb4-b875-6558d2f3759b for instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e on hv-cinder-85501 Aug 29 19:25:20.514809 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-e4f14a2c-e88e-4f33-92b9-94303006b469 req-d855b492-880e-4fc8-9f81-bf1e4066d2e1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035177 Aug 29 19:25:20.515424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 308/615] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:20.656850 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:20.657468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:20.663821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:20.664329 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:20.664759 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:20.665512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:20.665966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:20.666389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:20.805424 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:20.814561 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:20.816055 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:20.817202 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2d3268e6-2ce9-400e-b02b-9110f66f6c2b tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.164219 Aug 29 19:25:20.817959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 308/616] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:20 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:21.841923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:21.842618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:21.849201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:21.849691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:21.850126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:21.850858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:21.851258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:21.851680 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:21.868327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:22.019723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:22.028924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:22.030405 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:22.031506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-05e46595-10b2-450b-8e97-5c81571afb2a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.194395 Aug 29 19:25:22.032314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 309/617] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:21 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:23.054835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:23.055541 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:23.058144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.059378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.067194 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:23.068120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:23.068661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:23.069512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:23.070045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:23.070542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:23.108174 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:23.108759 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:23.110557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.111685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.116949 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:23.117430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:23.117858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:23.119057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:23.119518 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:23.119941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:23.347086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:23.360322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:23.366425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:23.367937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:23.370191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b1993e51-c48b-46aa-bd29-3225a53a5a10 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.319473 Aug 29 19:25:23.370630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 309/618] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:23 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:23.376783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-13e0e19a-9991-43c4-b163-b0ea98641b2c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1594 microversion: 2.1 time: 0.266640 Aug 29 19:25:23.376783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 310/619] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:23 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1594 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:23.948367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-b14a6148-f4e1-4276-ad13-5319ffe13760 req-33fe95ad-316c-4e87-90a7-2a0313222b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "name": "network-vif-plugged", "status": "completed", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:23.955964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.961051 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b14a6148-f4e1-4276-ad13-5319ffe13760 req-33fe95ad-316c-4e87-90a7-2a0313222b50 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:23.962531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b14a6148-f4e1-4276-ad13-5319ffe13760 req-33fe95ad-316c-4e87-90a7-2a0313222b50 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:23.962964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-b14a6148-f4e1-4276-ad13-5319ffe13760 req-33fe95ad-316c-4e87-90a7-2a0313222b50 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:23.975263 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-b14a6148-f4e1-4276-ad13-5319ffe13760 req-33fe95ad-316c-4e87-90a7-2a0313222b50 service nova] Creating event network-vif-plugged:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:25:23.981194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-b14a6148-f4e1-4276-ad13-5319ffe13760 req-33fe95ad-316c-4e87-90a7-2a0313222b50 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036890 Aug 29 19:25:23.981841 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 311/620] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:24.392436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:24.393040 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:24.400988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:24.401472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:24.401897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:24.402588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:24.403036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:24.403453 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:24.690223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:24.699300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:24.700821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:24.701922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ad1c4415-ca78-4df2-a52b-93b2f7e49d89 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.313462 Aug 29 19:25:24.702482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 310/621] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:24 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:25:25.602034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-ce9fe899-2fe7-4df3-8815-e2cacc184d98 req-668e3d56-dba3-4a42-88df-62aa9731bbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:25.614456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-ce9fe899-2fe7-4df3-8815-e2cacc184d98 req-668e3d56-dba3-4a42-88df-62aa9731bbc9 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:25.615212 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-ce9fe899-2fe7-4df3-8815-e2cacc184d98 req-668e3d56-dba3-4a42-88df-62aa9731bbc9 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:25.615652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-ce9fe899-2fe7-4df3-8815-e2cacc184d98 req-668e3d56-dba3-4a42-88df-62aa9731bbc9 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:25.627637 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-ce9fe899-2fe7-4df3-8815-e2cacc184d98 req-668e3d56-dba3-4a42-88df-62aa9731bbc9 service nova] Creating event network-changed:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:25:25.632578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-ce9fe899-2fe7-4df3-8815-e2cacc184d98 req-668e3d56-dba3-4a42-88df-62aa9731bbc9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035649 Aug 29 19:25:25.633212 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 312/622] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:25.725668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:25.727979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:25.735233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:25.736370 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:25.737707 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:25.738613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:25.739324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:25.739807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:25.983795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:25.993692 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:25.994541 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:25.995666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-06a34a4d-c863-436c-a2af-37391a653357 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1406 microversion: 2.20 time: 0.274320 Aug 29 19:25:25.996308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 311/623] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:25 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:27.019019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:27.019725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:27.027080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:27.027780 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:27.028244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:27.028962 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:27.029411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:27.029838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:27.191663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:27.201763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:27.203316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:27.204479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3a88ea35-da43-4a72-9285-3bbf35cb9c31 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1597 microversion: 2.20 time: 0.190458 Aug 29 19:25:27.205033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 313/624] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:25:27 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1597 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:25:27.228496 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:27.228990 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:27.231607 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:27.232136 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:27.235426 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:27.236063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:27.236793 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:27.237572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:27.238101 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:27.238273 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:27.238671 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:27.238860 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:27.239109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:27.239800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:27.240299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:27.240718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:27.322606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lazy-loading 'services' on Instance uuid 63d4166d-63f1-49f0-a7ce-487fb9ce176a {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:25:27.328069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-214eae6e-9744-40c5-8b55-3f5fc31af3c2 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104294 Aug 29 19:25:27.328776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 312/625] 10.222.0.62 () {60 vars in 1316 bytes} [Mon Aug 29 19:25:27 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:25:27.585240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-67e2ff7c-d7fc-4d56-a6e7-d294eb92daf3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-volume_attachments/80acf6f9-b210-4db2-8a1e-9a77004ac4cf" status: 202 len: 0 microversion: 2.1 time: 0.358306 Aug 29 19:25:27.586017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 314/626] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:25:27 2022] DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-volume_attachments/80acf6f9-b210-4db2-8a1e-9a77004ac4cf => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:25:28.789670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-1626f460-5667-412c-81b9-213d6443c78a req-c9cdbee6-228d-45c8-b213-3eaa5687a6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:28.800460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-1626f460-5667-412c-81b9-213d6443c78a req-c9cdbee6-228d-45c8-b213-3eaa5687a6b3 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:28.801203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-1626f460-5667-412c-81b9-213d6443c78a req-c9cdbee6-228d-45c8-b213-3eaa5687a6b3 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:28.801631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-1626f460-5667-412c-81b9-213d6443c78a req-c9cdbee6-228d-45c8-b213-3eaa5687a6b3 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:28.813345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-1626f460-5667-412c-81b9-213d6443c78a req-c9cdbee6-228d-45c8-b213-3eaa5687a6b3 service nova] Creating event network-changed:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:25:28.819332 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-1626f460-5667-412c-81b9-213d6443c78a req-c9cdbee6-228d-45c8-b213-3eaa5687a6b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033866 Aug 29 19:25:28.820215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 313/627] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:29.445605 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2138905032"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:29.446874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:29.453983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:29.454625 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:29.455192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:29.456046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:29.456629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:29.457154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:29.611076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.network.security_group_api [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Adding security group 6ebd2ccb-a5ba-4dd9-9830-088375c9121b to port f4f48f8b-94da-4737-981d-26c9f2705370 Aug 29 19:25:29.784256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f0ff46ce-66fe-4216-94e1-f88c8dbca126 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:29.787379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:29.792160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0ff46ce-66fe-4216-94e1-f88c8dbca126 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:29.792778 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0ff46ce-66fe-4216-94e1-f88c8dbca126 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:29.793066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f0ff46ce-66fe-4216-94e1-f88c8dbca126 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:29.816684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f0ff46ce-66fe-4216-94e1-f88c8dbca126 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Going to try to stop instance {{(pid=121336) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 19:25:30.156036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f0ff46ce-66fe-4216-94e1-f88c8dbca126 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action" status: 202 len: 0 microversion: 2.1 time: 0.375876 Aug 29 19:25:30.156647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 314/628] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:25:29 2022] POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:25:30.166983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6e589667-6b53-4c74-bcc7-53db4d70d431 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/action" status: 202 len: 0 microversion: 2.1 time: 0.725568 Aug 29 19:25:30.168385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 315/629] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:25:29 2022] POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:25:30.171479 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:30.172208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:30.176500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:30.177143 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:30.178714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:30.179231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:30.179663 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:30.180461 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:30.181095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:30.181524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:30.183868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:30.184384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:30.184817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:30.185713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:30.186174 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:30.186628 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:30.418602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:30.428859 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a9e12afc-2107-4a55-80e8-7255ae7a1728 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.261789 Aug 29 19:25:30.430037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 315/630] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:30 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:30.444654 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:30.450073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-abda96b6-5da0-4f0b-b8cb-9ed6c201752e tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1760 microversion: 2.1 time: 0.277425 Aug 29 19:25:30.450662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 316/631] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:30 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1760 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:30.836646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-9f8e80f1-2028-4d8d-b685-b314948c89e7 req-14473517-8935-4727-a233-d539eec988ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:30.848707 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-9f8e80f1-2028-4d8d-b685-b314948c89e7 req-14473517-8935-4727-a233-d539eec988ec service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:30.849179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-9f8e80f1-2028-4d8d-b685-b314948c89e7 req-14473517-8935-4727-a233-d539eec988ec service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:30.849600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-9f8e80f1-2028-4d8d-b685-b314948c89e7 req-14473517-8935-4727-a233-d539eec988ec service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:30.863165 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-9f8e80f1-2028-4d8d-b685-b314948c89e7 req-14473517-8935-4727-a233-d539eec988ec service nova] Creating event network-changed:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:25:30.868010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-9f8e80f1-2028-4d8d-b685-b314948c89e7 req-14473517-8935-4727-a233-d539eec988ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036075 Aug 29 19:25:30.868678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 316/632] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:25:31.451334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:31.451965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:31.458675 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:31.459160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:31.459600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:31.460319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:31.460775 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:31.461201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:31.595333 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:31.603770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2bb9127d-e968-416d-b3de-6545f0e9ff72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.156384 Aug 29 19:25:31.604363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 317/633] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:31 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:32.626134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:32.626964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:32.633076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:32.634112 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:32.634579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:32.635327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:32.635785 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:32.636236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:32.651789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:32.768151 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:32.775932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5dfd6a3a-9c19-4f37-b5d9-b692f9727c81 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.154427 Aug 29 19:25:32.776498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 317/634] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:32 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:33.796661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:33.797270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:33.803952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:33.804438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:33.804874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:33.806274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:33.806570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:33.806996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:33.947484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:33.955176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e95b747e-0034-455a-8890-cab62ece83f5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.162454 Aug 29 19:25:33.955730 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 318/635] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:33 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:34.976223 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:34.976835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:34.984028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:34.984516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:34.984949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:34.985684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:34.986808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:34.986808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:35.118327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:35.126154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-21cb75ab-33a4-44f9-a9d1-c2a6807232ba tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.153606 Aug 29 19:25:35.126729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 318/636] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:34 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:36.146666 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:36.147343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:36.155915 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:36.156411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:36.156852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:36.157576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:36.158039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:36.158487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:36.403513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:36.411651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-da4f3b07-caa3-4e87-9f94-8f3c42ea68b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.268947 Aug 29 19:25:36.412240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 319/637] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:36 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:37.433640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:37.434823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:37.440936 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:37.441448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:37.441888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:37.442616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:37.443115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:37.443567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:37.629546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:37.637272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c0a08344-8260-4758-a5c8-db00740f1b37 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.208116 Aug 29 19:25:37.637847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 319/638] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:37 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:38.658353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:38.658954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:38.665419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:38.665895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:38.666328 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:38.667017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:38.667501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:38.667950 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:38.799177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:38.807515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-249114a7-1035-4ea6-9780-7aafcb3021f0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.153059 Aug 29 19:25:38.808259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 320/639] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:38 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:39.829349 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:39.829972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:39.836550 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:39.837026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:39.837448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:39.838134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:39.838586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:39.839005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:39.971991 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:39.980537 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-dbeaccee-61b7-4555-9731-67f0a91fb70f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1677 microversion: 2.1 time: 0.154967 Aug 29 19:25:39.981109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 320/640] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:39 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:41.002894 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:41.003493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:41.010213 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:41.010685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:41.011115 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:41.011799 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:41.012269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:41.012781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:41.144902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:41.152562 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8a0d2deb-c6d3-49dc-89fc-a16de7144cdc tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1654 microversion: 2.1 time: 0.153851 Aug 29 19:25:41.153129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 321/641] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:40 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:41.173183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-232876f3-5b8f-4c5a-9d94-abbe3a966ec1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:41.179815 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-232876f3-5b8f-4c5a-9d94-abbe3a966ec1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:41.180840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-232876f3-5b8f-4c5a-9d94-abbe3a966ec1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:41.181271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-232876f3-5b8f-4c5a-9d94-abbe3a966ec1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:41.205086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-232876f3-5b8f-4c5a-9d94-abbe3a966ec1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Going to try to start instance {{(pid=121336) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 19:25:41.360844 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-232876f3-5b8f-4c5a-9d94-abbe3a966ec1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action" status: 202 len: 0 microversion: 2.1 time: 0.191255 Aug 29 19:25:41.361371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 321/642] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:25:41 2022] POST /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:25:41.370493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:41.371670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:41.377311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:41.377878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:41.378238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:41.378991 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:41.379451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:41.379905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:41.515408 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:41.524934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-59936b6e-6b9a-47e3-8228-a1556a482337 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1663 microversion: 2.1 time: 0.158993 Aug 29 19:25:41.525746 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 322/643] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:41 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:42.547591 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:42.548350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:42.554576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:42.555573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:42.556043 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:42.556798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:42.557254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:42.557679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:42.689147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:42.697616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-53948eea-963f-4d3b-bf31-459437c27fe0 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1663 microversion: 2.1 time: 0.154701 Aug 29 19:25:42.698172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 322/644] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:42 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:25:43.718508 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:43.720890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:43.725571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:43.726053 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:43.726482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:43.727233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:43.727685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:43.728132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:43.893348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:43.902287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2ea0b620-d4c5-4fae-8c1f-4b74e3803832 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1667 microversion: 2.1 time: 0.187589 Aug 29 19:25:43.903165 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 323/645] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:43 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:54.080515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:25:54.082951 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:54.085657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=17 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:54.086925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:54.092161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:54.092703 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:54.093160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:54.093903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:54.094385 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:54.094862 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:54.352659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1d474fc6-f701-4925-928f-752c47ffb082 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/action" status: 202 len: 0 microversion: 2.1 time: 0.276266 Aug 29 19:25:54.354207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 323/646] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:25:54 2022] POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:25:54.363687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:54.364432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:54.367179 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=25 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:54.367988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:54.372777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:54.373264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:54.373702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:54.374400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:54.374856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:54.375282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:54.527564 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:54.538665 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2aab4944-ef63-4bc8-92c4-06297b9eade1 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1752 microversion: 2.1 time: 0.179319 Aug 29 19:25:54.539246 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 324/647] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:54 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:55.562964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:55.563659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:55.570669 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:55.571148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:55.571580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:55.572295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:55.572749 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:55.577473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:55.722855 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:55.731011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-994c5b7c-da8c-4070-98a1-b009eab17ba5 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.173179 Aug 29 19:25:55.731570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 324/648] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:55 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:56.752244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:56.752905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:56.760218 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:56.760706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:56.761137 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:56.761868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:56.762316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:56.762738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:56.907885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:56.916175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-831edebc-2163-462c-b64e-fd17520e7d54 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.168444 Aug 29 19:25:56.916744 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 325/649] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:56 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:57.936790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:57.937445 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:57.943969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:57.944457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:57.945410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:57.946111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:57.946566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:57.946989 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:58.094460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:58.102920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fb92e64a-6de3-4eb6-b217-10b2fb4759d6 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.170044 Aug 29 19:25:58.103526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 325/650] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:57 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:25:59.126161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:25:59.126772 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:25:59.133195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:59.133675 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:59.134105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:59.134791 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:25:59.135240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:25:59.135662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:25:59.287657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:25:59.296146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-27a802fd-009a-40ff-a519-6be9ca423f81 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.173836 Aug 29 19:25:59.296902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 326/651] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:25:59 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:00.317547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:00.318126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:00.325103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:00.325590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:00.326027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:00.326727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:00.327185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:00.327613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:00.475474 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:00.483970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ee593e6b-5546-4b5b-ab0c-4d74517d5419 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.170366 Aug 29 19:26:00.484534 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 326/652] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:00 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:00.692334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:00.692870 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:00.700106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:00.700598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:00.701036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:00.701754 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:00.702206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:00.702679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:00.789838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'services' on Instance uuid cec9ec5e-04e7-4ed4-9611-4a2bcecd198e {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:01.042500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-81ec9a78-5957-4830-a782-e04b385112b9 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments/c19494ff-db9d-4abb-91df-d031839725cb" status: 202 len: 0 microversion: 2.1 time: 0.354477 Aug 29 19:26:01.043097 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 327/653] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:26:00 2022] DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments/c19494ff-db9d-4abb-91df-d031839725cb => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:26:01.052210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:01.055109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:01.061316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:01.061801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:01.062229 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:01.062929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:01.063379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:01.063798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:01.095985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5440602f-12d2-433f-a6af-c3a0204d9fa6 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048190 Aug 29 19:26:01.097299 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 327/654] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:01 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:01.505697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:01.506342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:01.513067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:01.513550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:01.513987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:01.514721 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:01.515204 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:01.515631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:01.663006 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:01.671747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d8656c08-dea5-455d-8e64-4528a257b296 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.170315 Aug 29 19:26:01.672353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 328/655] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:01 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:02.108606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:02.110709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:02.117473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:02.117955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:02.118409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:02.119103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:02.119558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:02.120018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:02.151120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6245ccd8-9762-47fb-9cc1-b37fbc96392f tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Aug 29 19:26:02.151702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 328/656] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:02 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:02.694263 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:02.695353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:02.701701 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:02.702177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:02.702615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:02.703353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:02.703805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:02.704255 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:02.849339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:02.857833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-92eb873a-9eeb-40fa-9546-b44bfabfa9fa tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.167450 Aug 29 19:26:02.858405 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 329/657] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:02 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:03.162977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:03.165716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:03.172668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.175935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.175935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.175935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.175935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.176318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.205204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0f13dfe8-96b9-4766-a983-91bc29833df7 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046320 Aug 29 19:26:03.208050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 329/658] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:03 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:26:03.290892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:03.291387 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:03.297471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.297946 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.298381 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.299087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.299541 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.300001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.326987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:26:03.676934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-517558bf-b14b-4fab-9fcf-6e4f9a421979 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 204 len: 0 microversion: 2.1 time: 0.390176 Aug 29 19:26:03.677526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 330/659] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:26:03 2022] DELETE /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:03.685646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:03.686290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:03.692335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.692677 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.693112 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.693805 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.694264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.694690 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.824388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:03.832075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-dfa5eaf9-d30e-4a33-b12e-13a67a12eb54 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1687 microversion: 2.1 time: 0.150228 Aug 29 19:26:03.832648 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 330/660] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:03 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:03.880668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:03.881398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:03.888351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.888834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.889272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:03.889968 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:03.890422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:03.890849 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:04.039155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:04.047494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-46a63417-1532-4906-9009-8fc887328441 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.171049 Aug 29 19:26:04.048297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 331/661] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:03 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:04.854290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:04.854900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:04.862146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:04.862630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:04.863065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:04.863765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:04.864297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:04.864722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:04.996924 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:05.004839 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-75000135-fd69-4849-99b7-7746ab8facaf tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1687 microversion: 2.1 time: 0.155005 Aug 29 19:26:05.005409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 331/662] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:04 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:05.068772 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:05.069379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:05.076200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:05.079209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:05.079209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:05.079209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:05.079209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:05.079808 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:05.228253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:05.237877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3c9d90b2-37e6-4df6-9141-ea970692817b tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.172908 Aug 29 19:26:05.238445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 332/663] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:05 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:06.026472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:06.027079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:06.033646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:06.034127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:06.034557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:06.035248 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:06.035699 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:06.036155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:06.168089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:06.175790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0a047798-1a94-4a61-b77b-08e38718f6d0 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1687 microversion: 2.1 time: 0.153284 Aug 29 19:26:06.176375 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 332/664] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:06 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:06.259134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:06.259651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:06.266211 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:06.266692 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:06.267125 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:06.267817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:06.268410 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:06.268836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:06.411317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:06.420084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4ccb08a2-aa7e-4311-b761-9bc41ad9483a tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.164979 Aug 29 19:26:06.420648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 333/665] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:06 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:07.198134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:07.198750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:07.205184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:07.205665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:07.206100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:07.206794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:07.207247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:07.207674 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:07.340958 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:07.348546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6afe994e-72e0-4038-9bd7-092e3cdd07f2 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1687 microversion: 2.1 time: 0.154897 Aug 29 19:26:07.349092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 333/666] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:07 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:07.444517 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:07.445781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:07.452185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:07.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:07.453111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:07.453830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:07.454314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:07.454848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:07.602558 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:07.611001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-275080bb-2d15-4091-b007-90d381050a61 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1757 microversion: 2.1 time: 0.170381 Aug 29 19:26:07.611566 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 334/667] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:07 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:08.369893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:08.370591 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:08.377022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:08.377504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:08.377932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:08.378622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:08.379069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:08.379486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:08.574229 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:08.582478 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bf5a5b36-7b32-46b4-8230-a7e364d10426 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1687 microversion: 2.1 time: 0.216521 Aug 29 19:26:08.583252 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 334/668] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:08 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:08.633297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:08.633847 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:08.640307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:08.640796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:08.641232 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:08.641925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:08.642377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:08.642828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:09.176885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:09.195818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-54be0236-0373-4530-a308-06b26e4f83a9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1760 microversion: 2.1 time: 0.567010 Aug 29 19:26:09.196431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 335/669] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:08 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1760 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:09.606819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:09.606819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:09.613133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:09.613624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:09.614064 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:09.614779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:09.615237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:09.615665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:09.705426 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:09.714150 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bfd1ff51-ce6d-404f-9aa5-13bf72bf9e58 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1620 microversion: 2.1 time: 0.113446 Aug 29 19:26:09.714883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 335/670] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:09 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1620 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:09.735054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-f5be50a2-e851-467c-8c3e-c331bb22ff8d req-5a530ebd-8810-4dfc-bf72-e12827575e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec9ec5e-04e7-4ed4-9611-4a2bcecd198e", "name": "network-vif-deleted", "tag": "38405fa8-e5ca-4cb4-b875-6558d2f3759b"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:09.746272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-f5be50a2-e851-467c-8c3e-c331bb22ff8d req-5a530ebd-8810-4dfc-bf72-e12827575e24 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:09.751695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-f5be50a2-e851-467c-8c3e-c331bb22ff8d req-5a530ebd-8810-4dfc-bf72-e12827575e24 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:09.751695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-f5be50a2-e851-467c-8c3e-c331bb22ff8d req-5a530ebd-8810-4dfc-bf72-e12827575e24 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:09.762440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-f5be50a2-e851-467c-8c3e-c331bb22ff8d req-5a530ebd-8810-4dfc-bf72-e12827575e24 service nova] Creating event network-vif-deleted:38405fa8-e5ca-4cb4-b875-6558d2f3759b for instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e on hv-cinder-85501 Aug 29 19:26:09.767727 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-f5be50a2-e851-467c-8c3e-c331bb22ff8d req-5a530ebd-8810-4dfc-bf72-e12827575e24 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036234 Aug 29 19:26:09.769131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 336/671] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:10.737161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:10.737811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:10.744669 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:10.745163 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:10.745604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:10.746328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:10.746822 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:10.747247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:10.781343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:10.781832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:10.782271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:10.782717 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'fault' on Instance uuid cec9ec5e-04e7-4ed4-9611-4a2bcecd198e {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:10.824081 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:10.832310 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-666814e6-879e-454d-a18d-41b8079fb284 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 200 len: 1334 microversion: 2.1 time: 0.100025 Aug 29 19:26:10.832901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 336/672] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:10 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:11.855350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:11.856591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: cec9ec5e-04e7-4ed4-9611-4a2bcecd198e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:11.862507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:11.862985 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:11.863414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:11.864129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:11.864577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:11.864996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:11.879248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] HTTP exception thrown: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e could not be found. Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Request method failure captured: Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e HTTP/1.1 Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGS7CeGZR4ahpSfByWIi7V0_wyW0sqlGbLKlWF5vh5AJwoiDEtOq5ubLUNqY19BiRcPpHzC6vqtLPi4PwMLsDB1Ioag7GifYTvppdhAFzucgg0mexKP_jbzVEfLmM0Tn5sBkW53pxMlGw35Y4z2-pccig1PgZWE4ogttXsGlxTGhPA Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:26:11.880944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fec9a23227784d23ba703719c785e413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fec9a23227784d23ba703719c785e413"}]}] Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: bd993c0493d447cb9b02e424a28e24bc Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e could not be found. Aug 29 19:26:11.883171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'cec9ec5e-04e7-4ed4-9611-4a2bcecd198e'} Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e could not be found. Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:26:11.884152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e could not be found. Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e could not be found. Aug 29 19:26:11.885699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:11.887050 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Returning 404 to user: Instance cec9ec5e-04e7-4ed4-9611-4a2bcecd198e could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:26:11.887050 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-20f214fa-ab05-4596-bc1d-92a37b0d7f29 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e" status: 404 len: 111 microversion: 2.1 time: 0.031957 Aug 29 19:26:11.887050 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 337/673] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:11 2022] GET /compute/v2.1/servers/cec9ec5e-04e7-4ed4-9611-4a2bcecd198e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:26:11.892260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a7e76aee-2be6-43b7-b756-7c87df3a0dab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '.version_select at 0x7f1fde37d430>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:11.990123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a7e76aee-2be6-43b7-b756-7c87df3a0dab tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49320106" status: 202 len: 0 microversion: 2.1 time: 0.101588 Aug 29 19:26:11.990827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 337/674] 10.222.0.62 () {58 vars in 1215 bytes} [Mon Aug 29 19:26:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49320106 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:26:12.265535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:12.266029 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:12.272088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:12.272578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:12.273014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:12.273709 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:12.274168 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:12.274595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:12.299471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-92ec40ab-f428-4565-967d-5bd94c6b0764 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/ips" status: 200 len: 150 microversion: 2.20 time: 0.092686 Aug 29 19:26:12.300490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 338/675] 10.222.0.62 () {60 vars in 1289 bytes} [Mon Aug 29 19:26:12 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:26:14.513078 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:14.513588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:14.521419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:14.521912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:14.522925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:14.523658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:14.524141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:14.524564 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:14.547163 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lazy-loading 'flavor' on Instance uuid 36d63dea-430c-4573-82f6-68d0b0e24fea {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:14.567687 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:15.047529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-364a853e-ef7f-4fac-824b-f9d6242774c4 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/action" status: 202 len: 0 microversion: 2.20 time: 0.539340 Aug 29 19:26:15.048184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 338/676] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 19:26:14 2022] POST /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:15.057087 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:15.057632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:15.064836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:15.065327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:15.065768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:15.066474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:15.066934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:15.067363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:15.202906 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:15.206486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:15.211489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:15.212965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:15.214117 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-32ae5c73-fac1-4153-b7c1-03a257876fa7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.161568 Aug 29 19:26:15.214676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 339/677] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:15 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:15.436538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:15.437134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:15.443472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:15.443990 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:15.445076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:15.445794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:15.446278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:15.446700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:15.472545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:26:15.740022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d32d8ca9-5f41-4467-a78f-7fe925fefb86 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 204 len: 0 microversion: 2.1 time: 0.307428 Aug 29 19:26:15.740677 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 339/678] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:26:15 2022] DELETE /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:15.750828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:15.751436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:15.758305 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:15.758787 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:15.759219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:15.760132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:15.760584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:15.761010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:15.892201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:15.900608 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f0fa402a-9de0-4f2e-8339-789639ca6f72 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1506 microversion: 2.1 time: 0.154222 Aug 29 19:26:15.901169 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 340/679] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:15 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:16.238475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:16.239170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:16.245206 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:16.245605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:16.246032 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:16.246710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:16.247159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:16.247578 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:16.383949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:16.392420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:16.393888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:16.395045 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f79617e7-5f87-4dfc-95ad-bf82d6253a81 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.161137 Aug 29 19:26:16.395607 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 340/680] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:16 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:26:16.922037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:16.922627 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:16.929640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:16.930126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:16.930559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:16.931248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:16.931700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:16.932159 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:17.060789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:17.068884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d05f8b0a-073c-4aaa-8188-a7c28651181e tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1506 microversion: 2.1 time: 0.151314 Aug 29 19:26:17.069577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 341/681] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:16 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:17.419220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:17.419807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:17.426168 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:17.426643 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:17.427094 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:17.427775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:17.428250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:17.429281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:17.560343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:17.568383 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:17.569876 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:17.571023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3ac9880c-b5dd-4272-bddc-56da825fa944 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.155759 Aug 29 19:26:17.571576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 341/682] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:17 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:18.089503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:18.090176 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:18.096452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:18.096946 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:18.097375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:18.098061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:18.098533 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:18.098959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:18.228476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:18.236065 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d7788f4d-e3bd-4e8f-aee0-332f0a325f34 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1506 microversion: 2.1 time: 0.150403 Aug 29 19:26:18.236627 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 342/683] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:18 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:18.594225 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:18.594820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:18.601405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:18.601890 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:18.602323 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:18.603022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:18.603484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:18.603938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:18.739881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:18.748657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:18.750108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:18.751329 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cfae71ea-a78f-4a35-9bbb-18d428837316 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.161126 Aug 29 19:26:18.751932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 342/684] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:18 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:19.260339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:19.261168 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:19.269001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:19.269498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:19.269938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:19.270652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:19.271105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:19.271735 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:19.351715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:19.361839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d2c29f12-fdf1-4f5e-bcec-1f22bc5bafca tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1464 microversion: 2.1 time: 0.107755 Aug 29 19:26:19.365060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 343/685] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:19 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1464 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:19.385450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-a367190d-5f60-4161-88f9-9fac36d740f0 req-d5da5dcd-9fe3-4cc9-a42a-c63ceb59a8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5054f226-cc23-4016-ac32-5461f6cd50b4", "name": "network-vif-deleted", "tag": "958285db-a662-4674-b8ba-03aeaded321b"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:19.395694 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a367190d-5f60-4161-88f9-9fac36d740f0 req-d5da5dcd-9fe3-4cc9-a42a-c63ceb59a8c1 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:19.396207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a367190d-5f60-4161-88f9-9fac36d740f0 req-d5da5dcd-9fe3-4cc9-a42a-c63ceb59a8c1 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:19.396639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-a367190d-5f60-4161-88f9-9fac36d740f0 req-d5da5dcd-9fe3-4cc9-a42a-c63ceb59a8c1 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:19.408436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-a367190d-5f60-4161-88f9-9fac36d740f0 req-d5da5dcd-9fe3-4cc9-a42a-c63ceb59a8c1 service nova] Creating event network-vif-deleted:958285db-a662-4674-b8ba-03aeaded321b for instance 5054f226-cc23-4016-ac32-5461f6cd50b4 on hv-cinder-85501 Aug 29 19:26:19.414002 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-a367190d-5f60-4161-88f9-9fac36d740f0 req-d5da5dcd-9fe3-4cc9-a42a-c63ceb59a8c1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096813 Aug 29 19:26:19.423369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 343/686] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:19.775299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:19.775937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:19.781898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:19.782381 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:19.782844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:19.783532 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:19.784011 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:19.784512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:19.923156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:19.932209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:19.933689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:19.934834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ece28cab-3761-4ef1-9398-d168db19c656 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.164150 Aug 29 19:26:19.935372 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 344/687] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:19 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:20.385317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:20.386036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:20.392963 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:20.393458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:20.393896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:20.394666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:20.395111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:20.395538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:20.426903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:20.427396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:20.427840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:20.428435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'fault' on Instance uuid 5054f226-cc23-4016-ac32-5461f6cd50b4 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:20.470932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:20.479261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e166475d-cc56-44ef-9e15-226f3673104b tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 200 len: 1311 microversion: 2.1 time: 0.098188 Aug 29 19:26:20.482971 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 344/688] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:20 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:20.957731 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:20.958386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:20.965300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:20.965779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:20.966219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:20.966911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:20.967359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:20.967813 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:21.111771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:21.120112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:21.121577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:21.122735 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0a8a031c-02e7-43cb-bdcb-cba0176e5a1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.168947 Aug 29 19:26:21.123302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 345/689] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:20 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:21.501067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:21.501679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 5054f226-cc23-4016-ac32-5461f6cd50b4] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:21.508713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:21.509197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:21.509631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:21.510327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:21.510784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:21.511211 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:21.524450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] HTTP exception thrown: Instance 5054f226-cc23-4016-ac32-5461f6cd50b4 could not be found. Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Request method failure captured: Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 HTTP/1.1 Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGS7CeGZR4ahpSfByWIi7V0_wyW0sqlGbLKlWF5vh5AJwoiDEtOq5ubLUNqY19BiRcPpHzC6vqtLPi4PwMLsDB1Ioag7GifYTvppdhAFzucgg0mexKP_jbzVEfLmM0Tn5sBkW53pxMlGw35Y4z2-pccig1PgZWE4ogttXsGlxTGhPA Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:26:21.526070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fec9a23227784d23ba703719c785e413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fec9a23227784d23ba703719c785e413"}]}] Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: bd993c0493d447cb9b02e424a28e24bc Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 5054f226-cc23-4016-ac32-5461f6cd50b4 could not be found. Aug 29 19:26:21.527450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '5054f226-cc23-4016-ac32-5461f6cd50b4'} Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5054f226-cc23-4016-ac32-5461f6cd50b4 could not be found. Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:26:21.528237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5054f226-cc23-4016-ac32-5461f6cd50b4 could not be found. Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5054f226-cc23-4016-ac32-5461f6cd50b4 could not be found. Aug 29 19:26:21.529640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:21.531077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Returning 404 to user: Instance 5054f226-cc23-4016-ac32-5461f6cd50b4 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:26:21.531077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-baea075c-cd34-4f7c-9089-c0da19bb5e90 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4" status: 404 len: 111 microversion: 2.1 time: 0.030438 Aug 29 19:26:21.531077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 345/690] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:21 2022] GET /compute/v2.1/servers/5054f226-cc23-4016-ac32-5461f6cd50b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:26:21.536445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:21.536940 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:21.542787 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:21.543263 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:21.543697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:21.544467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:21.544918 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:21.545339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:21.572152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:26:21.851826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-65aa3178-8ed4-4e80-96a4-7d5b248d7571 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 204 len: 0 microversion: 2.1 time: 0.318747 Aug 29 19:26:21.852577 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 346/691] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:26:21 2022] DELETE /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:26:21.860250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:21.860887 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:21.867647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:21.868159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:21.868593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:21.869288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:21.869740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:21.870161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:22.005231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:22.013089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-df1782b0-ef33-4850-8850-4f8ac7355a0d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.156628 Aug 29 19:26:22.013642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 346/692] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:21 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:22.148317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:22.148887 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:22.155521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:22.156049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:22.156488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:22.157185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:22.157638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:22.158060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:22.290157 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:22.298740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:22.300229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:22.305862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ac2ce11d-694e-45f1-b3ec-297fecb60f06 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.158421 Aug 29 19:26:22.305862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 347/693] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:22 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:23.033148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:23.033745 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:23.040892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:23.041377 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:23.041810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:23.042503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:23.043005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:23.043428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:23.177110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:23.185088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-51953bd8-0443-4ae2-9b9e-5239c1744344 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.155803 Aug 29 19:26:23.185647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 347/694] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:23 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:23.325226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:23.325771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:23.332236 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:23.332718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:23.333147 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:23.333833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:23.334285 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:23.335505 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:23.465129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:23.473371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:23.474820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:23.476033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-41c388fd-0866-4d3f-8077-0ebccdf185a6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.154824 Aug 29 19:26:23.476613 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 348/695] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:23 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:24.206682 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:24.207293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:24.213870 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:24.214359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:24.214794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:24.215496 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:24.216025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:24.216456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:24.345261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:24.353554 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d40ddf58-bdd9-4a47-b02a-59d4b3611ed1 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.150757 Aug 29 19:26:24.354117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 348/696] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:24 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:24.499682 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:24.500332 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:24.502686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:24.507378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:24.507889 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:24.508327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:24.509016 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:24.509470 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:24.509893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:24.644562 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:24.653288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:24.654723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:24.655971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-00532a04-a3e6-43cc-bbe2-5bd7efa1140f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.160428 Aug 29 19:26:24.656530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 349/697] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:24 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:25.374672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:25.375379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:25.378039 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:25.382960 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:25.383441 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:25.383893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:25.384590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:25.385044 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:25.385462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:25.582330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:25.590691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b878504d-47bf-4649-bdec-6be9c8a6371d tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1520 microversion: 2.1 time: 0.219842 Aug 29 19:26:25.591742 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 349/698] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:25 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:25.679788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:25.680454 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:25.687445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:25.687965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:25.698421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:25.698421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:25.698421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:25.698421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:25.797934 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-5cbfcc9e-c00e-46fb-be62-c7e2b7ea83b8 req-e4e732c7-601e-48aa-aa10-0a8cc1190109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f63a8f7-75a2-42ee-9699-a63c55b8c3ca", "name": "network-vif-deleted", "tag": "e3c64814-c08c-4b81-a5c7-4cbbce758a07"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:25.808986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-5cbfcc9e-c00e-46fb-be62-c7e2b7ea83b8 req-e4e732c7-601e-48aa-aa10-0a8cc1190109 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:25.809460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-5cbfcc9e-c00e-46fb-be62-c7e2b7ea83b8 req-e4e732c7-601e-48aa-aa10-0a8cc1190109 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:25.809888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-5cbfcc9e-c00e-46fb-be62-c7e2b7ea83b8 req-e4e732c7-601e-48aa-aa10-0a8cc1190109 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:25.824464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-5cbfcc9e-c00e-46fb-be62-c7e2b7ea83b8 req-e4e732c7-601e-48aa-aa10-0a8cc1190109 service nova] Creating event network-vif-deleted:e3c64814-c08c-4b81-a5c7-4cbbce758a07 for instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca on hv-cinder-85501 Aug 29 19:26:25.830179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-5cbfcc9e-c00e-46fb-be62-c7e2b7ea83b8 req-e4e732c7-601e-48aa-aa10-0a8cc1190109 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042578 Aug 29 19:26:25.830799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 350/699] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:26:25.867353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:25.876374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:25.877896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:25.879057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2d92ad6a-edb8-40fd-aaac-322ba5f80b82 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.203226 Aug 29 19:26:25.879609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 350/700] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:25 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:26.612220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:26.612831 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:26.619933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:26.620420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:26.620874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:26.621640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:26.622089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:26.622515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:26.654007 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:26.654475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:26.654911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:26.655343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lazy-loading 'fault' on Instance uuid 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:26.700261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd993c0493d447cb9b02e424a28e24bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9a23227784d23ba703719c785e413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:26.708026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1382e524-d05a-43c1-923c-fc1be1ec26aa tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 200 len: 1311 microversion: 2.1 time: 0.100782 Aug 29 19:26:26.708590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 351/701] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:26 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:26.902778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:26.903313 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:26.909769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:26.910361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:26.910734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:26.911426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:26.911901 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:26.912330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.049216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:27.058058 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:27.059478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:27.060702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-af84cf0c-e1e5-4804-8437-ba1b32e60f7a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.161964 Aug 29 19:26:27.061262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 351/702] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:26 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:27.379411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:27.382180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:27.388176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.388660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.389176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.389880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.390330 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.390769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.420082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cc380cc8-410e-4f30-ae2d-a70909e589c1 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044605 Aug 29 19:26:27.420757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 352/703] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:27 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:26:27.483586 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:27.484104 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:27.490214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.491215 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.491645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.492401 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.492855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.493278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.518398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:26:27.729249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:27.729845 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] [instance: 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:27.736351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.736887 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.737576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.738265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.738713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.739129 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.753794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] HTTP exception thrown: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca could not be found. Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Request method failure captured: Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca HTTP/1.1 Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGS7CeGZR4ahpSfByWIi7V0_wyW0sqlGbLKlWF5vh5AJwoiDEtOq5ubLUNqY19BiRcPpHzC6vqtLPi4PwMLsDB1Ioag7GifYTvppdhAFzucgg0mexKP_jbzVEfLmM0Tn5sBkW53pxMlGw35Y4z2-pccig1PgZWE4ogttXsGlxTGhPA Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:26:27.755888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fec9a23227784d23ba703719c785e413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fec9a23227784d23ba703719c785e413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fec9a23227784d23ba703719c785e413"}]}] Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: fec9a23227784d23ba703719c785e413 Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1623403990 Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: bd993c0493d447cb9b02e424a28e24bc Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1623403990-project Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca could not be found. Aug 29 19:26:27.758253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '9f63a8f7-75a2-42ee-9699-a63c55b8c3ca'} Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca could not be found. Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:26:27.759069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca could not be found. Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca could not be found. Aug 29 19:26:27.761154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:26:27.762454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] Returning 404 to user: Instance 9f63a8f7-75a2-42ee-9699-a63c55b8c3ca could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:26:27.762454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-92837fe6-2e55-4127-a2f2-4248743752f4 tempest-ServerRescueNegativeTestJSON-1623403990 tempest-ServerRescueNegativeTestJSON-1623403990-project] 10.222.0.62 "GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca" status: 404 len: 111 microversion: 2.1 time: 0.032324 Aug 29 19:26:27.762454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 353/704] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:27 2022] GET /compute/v2.1/servers/9f63a8f7-75a2-42ee-9699-a63c55b8c3ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:26:27.830913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1acffa44-6be9-45fe-8325-3de2f29e0d8f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 204 len: 0 microversion: 2.1 time: 0.350893 Aug 29 19:26:27.831515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 352/705] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:26:27 2022] DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:27.839974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:27.840695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:27.846738 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.847226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.847662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.848388 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:27.848875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:27.849294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:27.853987 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:27.985683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:27.995071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-024b5b33-e454-407c-a8ec-db22ffa1364c tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1673 microversion: 2.1 time: 0.159040 Aug 29 19:26:27.995655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 354/706] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:27 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:28.084890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:28.085582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:28.092117 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:28.092702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:28.093182 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:28.093873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:28.094496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:28.094908 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:28.099590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:28.239034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:28.247224 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:28.248729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:28.249888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d05dc89c-b85c-4b23-a502-f5759d88bdf8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.169529 Aug 29 19:26:28.250453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 353/707] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:28 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:29.016824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:29.017494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:29.024304 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:29.024802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:29.025230 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:29.025936 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:29.026387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:29.026806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:29.167154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:29.185383 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7b336085-8f19-427a-90f6-ac8062240feb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1673 microversion: 2.1 time: 0.172379 Aug 29 19:26:29.186240 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 355/708] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:29 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:29.273499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:29.274093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:29.281113 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:29.281600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:29.282033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:29.282741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:29.283202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:29.283673 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:29.424797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:29.433650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:29.435099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:29.436387 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9d28fa38-0306-4cfa-ae16-faeeef36cd5c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.166767 Aug 29 19:26:29.436882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 354/709] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:29 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:30.208365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:30.209047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:30.215673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:30.216205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:30.216641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:30.217336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:30.217792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:30.218218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:30.427893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:30.437590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-04c59440-7f43-44f9-8928-e6a838192376 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1673 microversion: 2.1 time: 0.233016 Aug 29 19:26:30.438031 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 356/710] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:30 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:30.462362 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:30.463363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:30.470922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:30.471648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:30.472211 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:30.473022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:30.473553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:30.474054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:30.782925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:30.792223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:30.793633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:30.794885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e696fa29-9beb-4d15-85c7-24eaed63dffc tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.338200 Aug 29 19:26:30.795441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 355/711] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:30 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:31.460030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:31.461748 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:31.487981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:31.495062 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:31.497206 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:31.498501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:31.501204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:31.501821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:31.793442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:31.805527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-47e3e78a-24a6-45c0-9405-23f4f1981069 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1673 microversion: 2.1 time: 0.349699 Aug 29 19:26:31.807779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 357/712] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:31 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1673 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:31.819190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:31.820618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:31.828003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:31.828833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:31.829480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:31.831145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:31.832034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:31.832659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:32.119698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:32.127389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-c56d8667-00f3-4a3e-97cd-da84b55566a5 req-a9d562dd-e150-4bb6-be58-cfc685e80a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d4166d-63f1-49f0-a7ce-487fb9ce176a", "name": "network-vif-deleted", "tag": "938c532b-1c36-4def-86e8-008b64f5cbf6"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:32.143733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c56d8667-00f3-4a3e-97cd-da84b55566a5 req-a9d562dd-e150-4bb6-be58-cfc685e80a08 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:32.143733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c56d8667-00f3-4a3e-97cd-da84b55566a5 req-a9d562dd-e150-4bb6-be58-cfc685e80a08 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:32.143733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c56d8667-00f3-4a3e-97cd-da84b55566a5 req-a9d562dd-e150-4bb6-be58-cfc685e80a08 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:32.145738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:32.151648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:32.153430 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-c56d8667-00f3-4a3e-97cd-da84b55566a5 req-a9d562dd-e150-4bb6-be58-cfc685e80a08 service nova] Creating event network-vif-deleted:938c532b-1c36-4def-86e8-008b64f5cbf6 for instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a on hv-cinder-85501 Aug 29 19:26:32.162833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fd231d59-ca25-4bf3-9299-0bb003e8718a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1742 microversion: 2.20 time: 0.338565 Aug 29 19:26:32.163903 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 356/713] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:31 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1742 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:32.164271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-c56d8667-00f3-4a3e-97cd-da84b55566a5 req-a9d562dd-e150-4bb6-be58-cfc685e80a08 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048306 Aug 29 19:26:32.165029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 358/714] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:32.829888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:32.830771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:32.850818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:32.850818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:32.850818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:32.850818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:32.851472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:32.851472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:32.901612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:32.902374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:32.903345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:32.903912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lazy-loading 'fault' on Instance uuid 63d4166d-63f1-49f0-a7ce-487fb9ce176a {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:32.951333 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:32.959973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8799de7e-72ad-4492-a245-515842119bdb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 200 len: 1328 microversion: 2.1 time: 0.134969 Aug 29 19:26:32.961121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 357/715] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:32 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:33.197904 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:33.199590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:33.206514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:33.207008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:33.207579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:33.208307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:33.208773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:33.209266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:33.395563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:33.406571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:33.408517 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:33.409929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a5fb9204-e03c-4683-a6dd-f99df1315b26 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.221533 Aug 29 19:26:33.423896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 359/716] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:33 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:33.986183 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:33.987503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:33.997469 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:33.998238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:33.998970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:33.999738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:34.000280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:34.000767 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:34.020130 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] HTTP exception thrown: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Request method failure captured: Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a HTTP/1.1 Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHp-hNadg193W4Qntvg3QO535FwWTijK7gGPOe9EqDrvE0IQcGeaVTM8QnIUvQVA-lwtPgGWJ3GNLjwSbJNpg1-Hc999IM9qcV6Ibj03yiebKr4L1bd0JhshQCNd2-FDXC3O7kIiXHhH7ToDiUEtFRWERltbHR9_VBd1TamSp_7kOQ Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:26:34.022247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e73450992ac46049edabd7000d44bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e73450992ac46049edabd7000d44bde"}]}] Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9d7e9a2846cc4ff3b64a8551a7a733a2 Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:26:34.024031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '63d4166d-63f1-49f0-a7ce-487fb9ce176a'} Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:26:34.025008 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:26:34.026599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:34.028833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Returning 404 to user: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:26:34.029815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-34c949a6-701d-4ea4-9340-e7bf8b025299 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 404 len: 111 microversion: 2.1 time: 0.048039 Aug 29 19:26:34.030318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 358/717] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:33 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:26:34.041933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4c0108c1-883d-4431-a25e-815b6db63dd7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '.version_select at 0x7f1fde327280>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:34.133033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4c0108c1-883d-4431-a25e-815b6db63dd7 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272174628" status: 202 len: 0 microversion: 2.1 time: 0.095395 Aug 29 19:26:34.133740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 360/718] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 19:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272174628 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:26:34.437350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:34.438053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:34.466853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:34.467739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:34.468384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:34.471769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:34.479457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:34.479457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:34.635839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-83052d6e-ce83-4ef4-bc38-a109d8c216ad req-636d0695-916f-4c5d-ae8d-a6cf91ffc629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "name": "network-vif-plugged", "status": "completed", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:34.654811 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-83052d6e-ce83-4ef4-bc38-a109d8c216ad req-636d0695-916f-4c5d-ae8d-a6cf91ffc629 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:34.655336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-83052d6e-ce83-4ef4-bc38-a109d8c216ad req-636d0695-916f-4c5d-ae8d-a6cf91ffc629 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:34.655772 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-83052d6e-ce83-4ef4-bc38-a109d8c216ad req-636d0695-916f-4c5d-ae8d-a6cf91ffc629 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:34.679226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-83052d6e-ce83-4ef4-bc38-a109d8c216ad req-636d0695-916f-4c5d-ae8d-a6cf91ffc629 service nova] Creating event network-vif-plugged:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:26:34.685028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-83052d6e-ce83-4ef4-bc38-a109d8c216ad req-636d0695-916f-4c5d-ae8d-a6cf91ffc629 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290482 Aug 29 19:26:34.686797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 359/719] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:34.883559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:34.897395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:34.903244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:34.906918 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-19cc4586-9178-47fe-9982-87e3cbf28ea5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.471386 Aug 29 19:26:34.916329 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 361/720] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:34 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:26:35.510181 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8341c6cc-2b64-47b7-b0b3-aa4337f69890 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: .version_select at 0x7f1fde5ae3a0>, body: {"keypair": {"name": "tempest-keypair-1666298163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+8kaM3Ss1qstC5d0y3z/jum1ODhXG6t/j1+QLut819Gao1G1uXtz0xIfhw9AM9+f/2vCLCRedpy6OUosDti/2UUzzIc1eClLTz8ViWO3LuHVegLj9ikQvop/yNF98d0g=="}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:35.527560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-8341c6cc-2b64-47b7-b0b3-aa4337f69890 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for project 8e73450992ac46049edabd7000d44bde. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:26:35.532510 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-8341c6cc-2b64-47b7-b0b3-aa4337f69890 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for user 9d7e9a2846cc4ff3b64a8551a7a733a2 and project 8e73450992ac46049edabd7000d44bde. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:26:35.635653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8341c6cc-2b64-47b7-b0b3-aa4337f69890 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131124 Aug 29 19:26:35.641355 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 360/721] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:26:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:35.951154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:35.952695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:35.960614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:35.961106 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:35.961535 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:35.962337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:35.963177 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:35.964194 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:36.255037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:36.267130 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:36.268961 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:36.270338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9fab1ee9-1733-4c7d-b18a-1a204ab66f9e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.324165 Aug 29 19:26:36.271253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 362/722] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:35 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:37.300580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:37.300580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:37.308653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:37.309222 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:37.309718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:37.310549 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:37.311129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:37.312155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:37.794594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:37.843193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:37.843193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:37.844817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7c061abd-5967-42cd-9d98-8222334daf46 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.552085 Aug 29 19:26:37.867781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 361/723] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:37 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:38.903258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:38.908287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:38.919164 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:38.931103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:38.934013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:38.934013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:38.934013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:38.934013 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:39.284212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:39.287459 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1715274010", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2845fe81-1a73-4dad-93b4-f9edcb5b7a00"}], "security_groups": [{"name": "tempest-securitygroup--660040205"}], "key_name": "tempest-keypair-1666298163", "user_data": "}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:39.300254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:39.302538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:39.307237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8ffcb955-1264-4223-b8c7-67146c26366f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.410849 Aug 29 19:26:39.324668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 363/724] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:38 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:39.439082 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] validate_networks() for [('2845fe81-1a73-4dad-93b4-f9edcb5b7a00', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:26:40.073375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:26:40.074178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:26:40.074681 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:26:40.075077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:26:40.075487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:26:40.089230 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:40.089748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:40.090180 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:40.090895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:40.091632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:40.092085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:40.119715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for project 8e73450992ac46049edabd7000d44bde. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:26:40.129988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Getting quotas for user 9d7e9a2846cc4ff3b64a8551a7a733a2 and project 8e73450992ac46049edabd7000d44bde. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:26:40.157817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:26:40.162575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:26:40.325239 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-210a1e2b-c2bd-4aa6-b623-ea80cda95f92 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.043484 Aug 29 19:26:40.334844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 362/725] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:26:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:26:40.336702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:40.337391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:40.340878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b7dfedbe-6d30-4d06-a4a8-47e552df588a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:40.341799 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b7dfedbe-6d30-4d06-a4a8-47e552df588a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:40.353984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:40.355046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:40.358019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:40.361808 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:40.362975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:40.364368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:40.424394 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b7dfedbe-6d30-4d06-a4a8-47e552df588a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:40.434738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b7dfedbe-6d30-4d06-a4a8-47e552df588a tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1238 microversion: 2.1 time: 0.097941 Aug 29 19:26:40.453216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 363/726] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:40 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:40.609754 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:40.635395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:40.635395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:40.636572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c1c61042-dcd0-4419-bc0a-d4fd634148a8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.305099 Aug 29 19:26:40.660657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 364/727] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:40 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:41.460219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d14c2cc1-f89a-4f81-ab9f-ba87e9d70c72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:41.461898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d14c2cc1-f89a-4f81-ab9f-ba87e9d70c72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:41.540668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d14c2cc1-f89a-4f81-ab9f-ba87e9d70c72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:41.554667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d14c2cc1-f89a-4f81-ab9f-ba87e9d70c72 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1238 microversion: 2.1 time: 0.093859 Aug 29 19:26:41.570850 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 364/728] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:41 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:41.665554 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:41.682482 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:41.712492 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:41.716229 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:41.720616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:41.721644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:41.722143 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:41.722596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:41.942301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:41.952770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:41.954746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:41.956513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e63d2bfc-a20e-46ff-bed1-330753924fff tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.295136 Aug 29 19:26:41.973898 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 365/729] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:41 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:42.283519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd07a1f0-c712-41fb-9a6f-e45fb68ecd12 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: .version_select at 0x7f1fde5c08b0>, body: {"keypair": {"name": "tempest-keypair-1279232467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf+XX/PxP3frutGsdRxeHzWWnoSvP0g3+2+QLPk3cnI42nTSci7JB6z/u1I6ld+P6ONHT2WG2lwuKgkthd0KU8/m0suROniBEMm5JNTqc5772I9m1AwJjH4TD1SdHomkg=="}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:42.283519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-cd07a1f0-c712-41fb-9a6f-e45fb68ecd12 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:26:42.283519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-cd07a1f0-c712-41fb-9a6f-e45fb68ecd12 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:26:42.495054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cd07a1f0-c712-41fb-9a6f-e45fb68ecd12 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.331810 Aug 29 19:26:42.495054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 365/730] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:26:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:42.577989 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:42.578602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:42.584956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:42.585634 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:42.592529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:42.592529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:42.592529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:42.592529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:42.660910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:42.670102 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-33ce96cf-2d17-4eab-acf1-ff9c3a7529ce tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1242 microversion: 2.1 time: 0.096266 Aug 29 19:26:42.671715 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 366/731] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:42 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:42.991896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:42.992553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:43.004734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:43.020897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:43.021422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:43.022217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:43.022684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:43.023154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:43.389283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:43.405375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:43.410447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:43.416922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-64aa1e6d-fb3a-43d7-9c65-2d03c563bcef tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.434401 Aug 29 19:26:43.422136 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 366/732] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:42 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:43.698134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:43.699580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:43.711801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:43.712626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:43.713275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:43.714155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:43.714940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:43.715527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:43.915568 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:43.924159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0e15b830-67f6-4f01-8b07-17498fdf21a8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1290 microversion: 2.1 time: 0.231647 Aug 29 19:26:43.929125 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 367/733] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:43 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1290 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:44.451930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:44.451930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:44.458170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:44.459108 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:44.459792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:44.460811 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:44.461492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:44.462160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:44.793397 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:44.804027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:44.805696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:44.809561 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7d81c464-361c-4220-a948-27c5a427f15c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.362449 Aug 29 19:26:44.810740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 367/734] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:44 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:44.949664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:44.950304 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:44.961250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:44.964226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:44.964853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:44.968827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:44.969545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:44.973851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:45.196557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:45.204251 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-dcc4872d-5fe7-4059-a89a-1bc2c37bd770 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1296 microversion: 2.1 time: 0.258278 Aug 29 19:26:45.210456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 368/735] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:44 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1296 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:45.833627 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:45.834431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:45.855039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:45.855039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:45.855039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:45.855444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:45.855789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:45.856507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:46.105984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:46.117545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:46.119310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:46.121858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-91965463-1db7-4d5d-9dde-83c4a72b59ae tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.291011 Aug 29 19:26:46.121858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 368/736] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:45 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:46.240657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:46.241227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:46.252077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1177546650", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8927a541-9264-4ca6-885d-504e7408d7ca"}], "security_groups": [{"name": "tempest-securitygroup--1042428297"}], "key_name": "tempest-keypair-1279232467", "user_data": "}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:46.254258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:46.254866 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:46.255446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:46.257314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:46.258603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:46.259159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:46.535717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] validate_networks() for [('8927a541-9264-4ca6-885d-504e7408d7ca', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:26:46.542164 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:46.557297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c43a8e97-43df-419b-97b5-f87fea943939 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.324335 Aug 29 19:26:46.563827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 369/737] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:46 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:47.145871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:47.147052 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:47.153747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:47.154258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:47.155725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:47.155725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:47.156655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:47.156655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:47.512102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:26:47.512772 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:26:47.513985 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:26:47.514555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:26:47.515052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:26:47.536218 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:47.539624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:47.541616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:47.550132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:47.550132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:47.550132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:47.550132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:47.550657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:47.553915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:47.555746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3110ae6b-a517-4df2-990a-3fd54ac5be96 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.413886 Aug 29 19:26:47.557300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 370/738] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:47 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:26:47.578072 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:26:47.583123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:26:47.586571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:47.587188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:47.595063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:47.595248 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:47.597088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:26:47.597978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:47.598614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:47.599984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:26:47.600553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:47.601091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:47.601952 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:47.764998 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:47.774212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-318afa1b-94eb-4b13-a380-d2d97cb674cb tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.192043 Aug 29 19:26:47.774415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8ce28156-5198-4815-ac60-091321cde413 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.526215 Aug 29 19:26:47.775016 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 369/739] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:26:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:26:47.775592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 371/740] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:47 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:47.799149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-546b78e4-2d39-4668-b8cc-ae02381374ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:47.799815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-546b78e4-2d39-4668-b8cc-ae02381374ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:47.908128 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-546b78e4-2d39-4668-b8cc-ae02381374ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:47.920473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-546b78e4-2d39-4668-b8cc-ae02381374ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1242 microversion: 2.1 time: 0.138025 Aug 29 19:26:47.921758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 370/741] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:47 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:47.964646 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-d9b5328d-34cc-4d11-bb37-e77b6e56e4ab req-15e33d9b-d860-4169-b59b-03b3042e039d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0677d1b1-2e5a-4615-8409-7ed46c414b1f", "tag": "5f802974-a79d-4fc1-8c0e-137e75f2fd38"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:48.002738 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d9b5328d-34cc-4d11-bb37-e77b6e56e4ab req-15e33d9b-d860-4169-b59b-03b3042e039d service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.006653 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d9b5328d-34cc-4d11-bb37-e77b6e56e4ab req-15e33d9b-d860-4169-b59b-03b3042e039d service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.010777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d9b5328d-34cc-4d11-bb37-e77b6e56e4ab req-15e33d9b-d860-4169-b59b-03b3042e039d service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:48.032288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-d9b5328d-34cc-4d11-bb37-e77b6e56e4ab req-15e33d9b-d860-4169-b59b-03b3042e039d service nova] Creating event network-changed:5f802974-a79d-4fc1-8c0e-137e75f2fd38 for instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f on hv-cinder-85501 Aug 29 19:26:48.039442 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-d9b5328d-34cc-4d11-bb37-e77b6e56e4ab req-15e33d9b-d860-4169-b59b-03b3042e039d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223728 Aug 29 19:26:48.040779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 372/742] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:26:48.156372 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2138905032"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:48.157259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:48.165683 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.166511 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.167884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:48.168858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.169555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.170197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:48.381828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.network.security_group_api [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Removing security group 6ebd2ccb-a5ba-4dd9-9830-088375c9121b from port f4f48f8b-94da-4737-981d-26c9f2705370 Aug 29 19:26:48.580640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:48.582368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:48.596288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.596981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.597521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:48.598366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.599667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.602308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:48.616413 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=100 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:48.839467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:48.848361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:48.849941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:48.851110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-59c93cbf-91e4-4475-8fd5-2619452ff140 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.276161 Aug 29 19:26:48.851661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 373/743] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:48 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:26:48.856046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:48.856644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:48.863115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.863595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.864059 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:48.864754 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:48.865203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:48.865620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:49.011068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:49.024510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8f402df0-d670-4af4-901a-99e16a69ab83 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.171767 Aug 29 19:26:49.036256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 374/744] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:48 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:49.043778 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7e17faec-79d0-4946-b8f5-fbff782472d5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:49.044456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7e17faec-79d0-4946-b8f5-fbff782472d5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:49.048614 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-acc21f61-3e5a-4604-bfd6-50e08c82d0ba tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/action" status: 202 len: 0 microversion: 2.1 time: 0.895645 Aug 29 19:26:49.049818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 371/745] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:26:48 2022] POST /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:26:49.064947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-502ac3e3-119e-4455-9f99-de37231af370 req-08698ba4-0931-4cd5-a468-8c4b71dd8d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:49.092596 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-502ac3e3-119e-4455-9f99-de37231af370 req-08698ba4-0931-4cd5-a468-8c4b71dd8d61 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:49.094584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-502ac3e3-119e-4455-9f99-de37231af370 req-08698ba4-0931-4cd5-a468-8c4b71dd8d61 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:49.095028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-502ac3e3-119e-4455-9f99-de37231af370 req-08698ba4-0931-4cd5-a468-8c4b71dd8d61 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:49.116451 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7e17faec-79d0-4946-b8f5-fbff782472d5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:49.127777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7e17faec-79d0-4946-b8f5-fbff782472d5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1242 microversion: 2.1 time: 0.090086 Aug 29 19:26:49.137243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 375/746] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:49 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:49.144438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-502ac3e3-119e-4455-9f99-de37231af370 req-08698ba4-0931-4cd5-a468-8c4b71dd8d61 service nova] Creating event network-changed:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:26:49.151492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-502ac3e3-119e-4455-9f99-de37231af370 req-08698ba4-0931-4cd5-a468-8c4b71dd8d61 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090392 Aug 29 19:26:49.155986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 372/747] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:49.874447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:49.875020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:49.884200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:49.884695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:49.885127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:49.886051 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:49.886704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:49.887325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:50.050014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:50.051944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:50.062619 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:50.069148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:50.069148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:50.069148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:50.069148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:50.069500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:50.303911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:50.314943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:50.316598 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:50.318683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1afbe283-a321-4d7a-93c7-9e227ae9022a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1737 microversion: 2.20 time: 0.448283 Aug 29 19:26:50.319540 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 376/748] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:49 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1737 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:50.325610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:50.326622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:50.335451 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:50.335451 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:50.336952 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:50.337530 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:50.337992 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:50.338408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:50.421700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:50.432113 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3cf2c5c0-a146-4a56-b29c-874e33bfbff3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.386819 Aug 29 19:26:50.447905 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 373/749] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:50 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:50.455292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:50.464533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-56fe626f-f07c-42d0-a03e-667e3be25ebf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1238 microversion: 2.1 time: 0.143507 Aug 29 19:26:50.466129 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 377/750] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:50 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:50.982718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:50.983519 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:50.991547 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:50.992797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:50.994100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:50.994994 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:50.995471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:50.995931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.084525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lazy-loading 'services' on Instance uuid 16306477-fb36-40c9-822e-b7ea4ff41dd0 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:51.166172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-420d7e7c-77d8-44e3-a56d-5c517f782639 req-4bf9f512-e39a-4e0c-9a65-1ff8d5d76a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:51.176619 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-420d7e7c-77d8-44e3-a56d-5c517f782639 req-4bf9f512-e39a-4e0c-9a65-1ff8d5d76a7d service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.177087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-420d7e7c-77d8-44e3-a56d-5c517f782639 req-4bf9f512-e39a-4e0c-9a65-1ff8d5d76a7d service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.177523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-420d7e7c-77d8-44e3-a56d-5c517f782639 req-4bf9f512-e39a-4e0c-9a65-1ff8d5d76a7d service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.198861 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-420d7e7c-77d8-44e3-a56d-5c517f782639 req-4bf9f512-e39a-4e0c-9a65-1ff8d5d76a7d service nova] Creating event network-changed:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:26:51.204109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-420d7e7c-77d8-44e3-a56d-5c517f782639 req-4bf9f512-e39a-4e0c-9a65-1ff8d5d76a7d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041551 Aug 29 19:26:51.204974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 378/751] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:51.343649 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:51.344692 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:51.359749 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.360286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.360725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.361448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.361932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.362621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.376907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f19e30e9-1198-455a-98fd-54798eb4c08c tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments/42a36527-0349-4aae-9b94-5727890828d0" status: 202 len: 0 microversion: 2.1 time: 0.402501 Aug 29 19:26:51.380244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 374/752] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:26:50 2022] DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments/42a36527-0349-4aae-9b94-5727890828d0 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:26:51.397699 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:51.402593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:51.409482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.410304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.410987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.411841 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.412904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.413430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.451933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b40e69e6-b0e6-4da7-86d9-b8185626ea38 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066782 Aug 29 19:26:51.452771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 375/753] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:51 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:26:51.463410 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:51.464243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:51.471483 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.472343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.472937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:51.473934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:51.475363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:51.475805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:52.071918 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:52.084321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:52.086396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:52.088144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2fd8d1e2-f437-4148-b812-aae4ee2e7875 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1719 microversion: 2.20 time: 0.749180 Aug 29 19:26:52.089850 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 379/754] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:51 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1719 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:26:52.095319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:52.096174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:52.105253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:52.106079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:52.106830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:52.109225 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:52.109878 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:52.110865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:52.158856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:52.171522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6e89a828-2fef-4aba-90dd-cce5c1e2dde9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.713036 Aug 29 19:26:52.172503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 376/755] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:51 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:52.255155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:52.279158 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8e7541b6-04f3-4abe-80c3-8a25757bf3ae tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1302 microversion: 2.1 time: 0.187955 Aug 29 19:26:52.280772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 380/756] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:52 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1302 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:52.465092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:52.468945 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:52.481993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:52.482489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:52.482922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:52.483632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:52.484271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:52.484695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:52.504226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:52.522957 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a5874f57-672f-452c-8ffe-890b7ebe0ab9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062586 Aug 29 19:26:52.523943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 377/757] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:52 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:52.577860 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-674ec4dc-9aa4-4e38-b322-58d45cef6691 req-7d4ffb35-7e19-499f-98fe-ff0e384e6590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0677d1b1-2e5a-4615-8409-7ed46c414b1f", "name": "network-vif-plugged", "status": "completed", "tag": "5f802974-a79d-4fc1-8c0e-137e75f2fd38"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:52.588382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-674ec4dc-9aa4-4e38-b322-58d45cef6691 req-7d4ffb35-7e19-499f-98fe-ff0e384e6590 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:52.588867 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-674ec4dc-9aa4-4e38-b322-58d45cef6691 req-7d4ffb35-7e19-499f-98fe-ff0e384e6590 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:52.589300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-674ec4dc-9aa4-4e38-b322-58d45cef6691 req-7d4ffb35-7e19-499f-98fe-ff0e384e6590 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:52.603189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-674ec4dc-9aa4-4e38-b322-58d45cef6691 req-7d4ffb35-7e19-499f-98fe-ff0e384e6590 service nova] Creating event network-vif-plugged:5f802974-a79d-4fc1-8c0e-137e75f2fd38 for instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f on hv-cinder-85501 Aug 29 19:26:52.608349 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-674ec4dc-9aa4-4e38-b322-58d45cef6691 req-7d4ffb35-7e19-499f-98fe-ff0e384e6590 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034492 Aug 29 19:26:52.608959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 381/758] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:26:53.117643 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:53.120858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:53.125740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.126231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.126669 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.127377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.127829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.128822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.193088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:53.194016 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:53.205602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.206588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.207422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.209295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.210204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.210639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.385591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:53.397474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:53.399164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:53.400638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-65014d9b-880e-46c3-9e46-05db7e476f04 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1719 microversion: 2.20 time: 0.287463 Aug 29 19:26:53.416240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 378/759] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:53 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1719 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:53.417871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:53.422191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:53.422830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:53.426908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1eefa9df-0318-432e-8def-3ed251187288 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.238335 Aug 29 19:26:53.427636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 382/760] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:53 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:53.433350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.433914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.434413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.435184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.435794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.436281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.537440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:53.540076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:53.546199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.546686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.547204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.547941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:53.548394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:53.548816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:53.574694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:53.579905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d444380d-07b3-4961-b995-3e07206ec077 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046983 Aug 29 19:26:53.580831 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 383/761] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:53 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:26:53.584546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-45edbcb1-86cb-449f-bef2-a284a6b3ca0a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.166284 Aug 29 19:26:53.585109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 379/762] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:53 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:54.429147 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:54.430396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:54.437411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.439378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.439378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.439378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.439645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.439949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.450865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:54.452088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:54.462017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.462859 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.463829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.465324 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.466040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.466593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.722834 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:54.731139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:54.732775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:54.734038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3289de74-d106-4282-bf49-409ee89e7e1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1722 microversion: 2.20 time: 0.309417 Aug 29 19:26:54.734712 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 384/763] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:54 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:26:54.754790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:54.754790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:54.754790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.754790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.755940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.755940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.755940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.755940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.756295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:54.760917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-dd747be4-bb63-40d7-b4ad-529cf9302d88 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.314682 Aug 29 19:26:54.761479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 380/764] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:54 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:54.768121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:54.768121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:54.774187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.778316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.778316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.778316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.778316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.778695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.782970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c87ad8a6-c90b-4270-9abd-5a49aece94fc tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047145 Aug 29 19:26:54.783547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 385/765] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:26:54 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:26:54.788970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-223d65d0-1fb1-43a7-ac40-28446fea3a7d req-68dbc7fd-1d55-47c7-be1d-d102886aaccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "name": "network-vif-unplugged", "status": "completed", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:54.798874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-223d65d0-1fb1-43a7-ac40-28446fea3a7d req-68dbc7fd-1d55-47c7-be1d-d102886aaccb service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.799301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-223d65d0-1fb1-43a7-ac40-28446fea3a7d req-68dbc7fd-1d55-47c7-be1d-d102886aaccb service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.799729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-223d65d0-1fb1-43a7-ac40-28446fea3a7d req-68dbc7fd-1d55-47c7-be1d-d102886aaccb service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.812387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-223d65d0-1fb1-43a7-ac40-28446fea3a7d req-68dbc7fd-1d55-47c7-be1d-d102886aaccb service nova] Creating event network-vif-unplugged:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:26:54.817420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-223d65d0-1fb1-43a7-ac40-28446fea3a7d req-68dbc7fd-1d55-47c7-be1d-d102886aaccb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032707 Aug 29 19:26:54.818056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 386/766] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:54.823766 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb813b3d-5ac4-4eb8-91f1-83303cc44b6e"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:54.826378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:54.833149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.833700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.834137 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.849503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.849503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.849503 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.975171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:54.983109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6e280c2c-9cf9-4f07-82e4-d14064801144 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.220662 Aug 29 19:26:54.983674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 381/767] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:54 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:54.989324 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:54.990759 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:54.996855 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.997350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.997948 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:54.998606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:54.999061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:54.999485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:55.078822 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] HTTP exception thrown: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 is not attached to volume 42a36527-0349-4aae-9b94-5727890828d0 Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Request method failure captured: Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments/42a36527-0349-4aae-9b94-5727890828d0 HTTP/1.1 Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRJp9_-_ukpqDtQgPhWrT3CIUUElV0Vapv88L_dWgXygzs2dFBZuNKjD7JXoKwxXb_Lwqq4cT-hmQzGIg2O5sLDjogz4v0JxxVhHSTsVP2PwpMriVT_06H8HfgKH1MxXr62D3aZKvRjaj4LUpfK3Tp5nCqfhHA_AnWO5nB3z2IDUJLc Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: fd9cf517497a40f6baebabe7bc3ea73f Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-TestMinimumBasicScenario-1462127863 Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:26:55.081320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fd9cf517497a40f6baebabe7bc3ea73f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fd9cf517497a40f6baebabe7bc3ea73f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fd9cf517497a40f6baebabe7bc3ea73f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fd9cf517497a40f6baebabe7bc3ea73f"}]}] Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-TestMinimumBasicScenario-1462127863 Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: fd9cf517497a40f6baebabe7bc3ea73f Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1462127863 Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-TestMinimumBasicScenario-1462127863-project Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 1c994f449c0c45b3b04ba9c96d80a824 Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-TestMinimumBasicScenario-1462127863-project Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:26:55.082934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 is not attached to volume 42a36527-0349-4aae-9b94-5727890828d0 Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'server_id': '16306477-fb36-40c9-822e-b7ea4ff41dd0', 'id': '42a36527-0349-4aae-9b94-5727890828d0'} Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 42a36527-0349-4aae-9b94-5727890828d0. Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:26:55.083741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 is not attached to volume 42a36527-0349-4aae-9b94-5727890828d0 Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 is not attached to volume 42a36527-0349-4aae-9b94-5727890828d0 Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:26:55.085294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Returning 404 to user: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 is not attached to volume 42a36527-0349-4aae-9b94-5727890828d0 {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:26:55.086399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cd4d1703-917c-41dd-8c3d-854bfcba77ad tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments/42a36527-0349-4aae-9b94-5727890828d0" status: 404 len: 154 microversion: 2.1 time: 0.098097 Aug 29 19:26:55.086399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 382/768] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:26:54 2022] DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0/os-volume_attachments/42a36527-0349-4aae-9b94-5727890828d0 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:26:55.088385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-1d9903ce-730f-4167-a924-c5ecbd13243a req-c323908b-2fc4-479c-b3fb-d672623aab71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b272a17-8d0c-46ec-a9c7-3399b2785ce7", "tag": "da59f026-4ad6-4294-8560-85ff077f3af8"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:55.100852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1d9903ce-730f-4167-a924-c5ecbd13243a req-c323908b-2fc4-479c-b3fb-d672623aab71 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:55.101250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1d9903ce-730f-4167-a924-c5ecbd13243a req-c323908b-2fc4-479c-b3fb-d672623aab71 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:55.101686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1d9903ce-730f-4167-a924-c5ecbd13243a req-c323908b-2fc4-479c-b3fb-d672623aab71 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:55.114215 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-1d9903ce-730f-4167-a924-c5ecbd13243a req-c323908b-2fc4-479c-b3fb-d672623aab71 service nova] Creating event network-changed:da59f026-4ad6-4294-8560-85ff077f3af8 for instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 on hv-cinder-85501 Aug 29 19:26:55.119618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-1d9903ce-730f-4167-a924-c5ecbd13243a req-c323908b-2fc4-479c-b3fb-d672623aab71 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035116 Aug 29 19:26:55.120251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 383/769] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:55.784200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:55.784965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:55.791776 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:55.792351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:55.792792 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:55.793564 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:55.794034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:55.794442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:55.935872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:55.943551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cfc97300-0abb-4b06-ac27-96612587d4c3 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1363 microversion: 2.1 time: 0.164465 Aug 29 19:26:55.944153 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 384/770] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:55 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:56.005056 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:56.005615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:56.011811 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.012344 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.012807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.015304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.015304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.015304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.036048 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d1048144-e584-4e20-9303-1cff63193170 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.216598 Aug 29 19:26:56.037395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 387/771] 10.222.0.62 () {62 vars in 1364 bytes} [Mon Aug 29 19:26:54 2022] POST /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-volume_attachments => generated 188 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:26:56.163007 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:56.171001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5d9a6a2a-e9a2-4803-aa2e-cd49ab7e8fda tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.169831 Aug 29 19:26:56.171564 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 385/772] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:55 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:56.177632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:56.178351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:56.180510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:56.189852 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.190338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.190763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.191630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.192111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.192565 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.369144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:56.417101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:56.417595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:56.423702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.424216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.424650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.426477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.426931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.427359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.455278 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:26:56.833210 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9a89eb1e-61d6-4bf7-8701-57687537d315 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 204 len: 0 microversion: 2.1 time: 0.420218 Aug 29 19:26:56.833892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 386/773] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:26:56 2022] DELETE /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:56.839995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:56.840402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:56.846688 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.847168 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.847598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.848324 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.848780 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.849198 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.861350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c96daa42-b8e3-45c4-8d88-f5f0aeff13c1 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-volume_attachments/cb813b3d-5ac4-4eb8-91f1-83303cc44b6e" status: 202 len: 0 microversion: 2.20 time: 0.687622 Aug 29 19:26:56.873278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 388/774] 10.222.0.62 () {60 vars in 1457 bytes} [Mon Aug 29 19:26:56 2022] DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-volume_attachments/cb813b3d-5ac4-4eb8-91f1-83303cc44b6e => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:56.873278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:56.873278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:56.874194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lazy-loading 'flavor' on Instance uuid fdf00998-1f50-44db-b548-fe6bc04f5742 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:26:56.878658 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.879160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.879784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:56.881372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:56.881851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:56.882278 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.024644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:57.032490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3c9261b8-ff14-427a-ad91-04651b8572c9 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1554 microversion: 2.1 time: 0.169153 Aug 29 19:26:57.033073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 389/775] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:56 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:57.038214 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:57.038829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:57.046387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.048360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.048360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.048565 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.048944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.049371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.081080 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121336) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:26:57.278868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-47e6b4db-9535-47df-a287-3610c1591159 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "POST /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742/action" status: 202 len: 0 microversion: 2.1 time: 0.443661 Aug 29 19:26:57.282295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 387/776] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:26:56 2022] POST /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:26:57.288771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:57.289536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:57.296119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.296636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.297070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.297771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.298237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.298667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.466482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:57.479123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c141180f-4e5f-488e-ac5f-d4eb58bc2286 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1549 microversion: 2.1 time: 0.195465 Aug 29 19:26:57.479526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [32cf3a25-dd6e-4eb9-9a12-894db6635f37] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 19:26:57.479708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 388/777] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:57 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:57.484463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:57.485411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:57.491768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.492296 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.492722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.493467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.494009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.494476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.559241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=4 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:57.651935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:57.659612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d35db260-ae7c-4d5f-a301-b3999e5eb1fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.178920 Aug 29 19:26:57.660197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 389/778] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:57 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:57.664578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:57.665173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:57.671088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.671563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.672057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.672707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.673156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.673570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.809911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:57.817686 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6093f1d0-4505-4e7e-a840-acfb583cfe3e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.156569 Aug 29 19:26:57.818239 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 390/779] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:57 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:57.822673 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:57.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:57.829320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.829800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.830230 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.830917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:57.831365 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:57.831783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:57.835532 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:57.910989 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d54c2e6e-5fb2-4716-ac0c-6af76efc79bf tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091645 Aug 29 19:26:57.912499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 391/780] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:26:57 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:58.054098 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:58.054735 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:58.056934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=26 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:58.062022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.062431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.062858 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.063553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.064031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.064455 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.199819 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:58.208556 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-528845d3-5bd3-4801-8949-b08fdaed4bb4 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1554 microversion: 2.1 time: 0.158274 Aug 29 19:26:58.210048 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 392/781] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:58 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:58.486742 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [32cf3a25-dd6e-4eb9-9a12-894db6635f37] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 60192. Aug 29 19:26:58.490725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6c3831d2-a56e-49c0-92a9-8d8947b14ac3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "POST /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/action" status: 202 len: 0 microversion: 2.20 time: 1.456658 Aug 29 19:26:58.495121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 390/782] 10.222.0.62 () {62 vars in 1319 bytes} [Mon Aug 29 19:26:57 2022] POST /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/action => generated 0 bytes in 1461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:26:58.500580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:58.501283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:58.508501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.512049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.512049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.512049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.512049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.512441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.649221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:58.659170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:58.660625 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:58.661829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b569595f-ad46-4741-8570-c22e926e0a08 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1670 microversion: 2.20 time: 0.165360 Aug 29 19:26:58.662385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 393/783] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:58 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:26:58.685121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:58.685970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:58.692307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.694191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.694191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.694519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.694984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.695424 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.840347 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:58.840947 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:58.841884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:58.849062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.849312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-603d06fe-fe5a-4fa6-a768-d41fc6c21116 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.168086 Aug 29 19:26:58.849911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 391/784] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:58 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:58.850318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.850951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:58.851829 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:58.852518 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:58.853105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.011711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:59.025903 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-10cebf56-cd36-4a7e-ab2e-cc13d343b5e1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.189955 Aug 29 19:26:59.029439 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 394/785] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:58 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:26:59.230632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:59.231472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:59.233571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:59.239003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.240102 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.240767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.241591 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.242219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.242650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.385675 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:26:59.393594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-41d6fc91-82be-4309-b694-3bc574a07c57 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1554 microversion: 2.1 time: 0.166853 Aug 29 19:26:59.396586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 392/786] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:59 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:26:59.452028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-1ab571af-144d-4eec-adf8-00f9a4ee6bc2 req-a730b5e0-db4a-46b4-a15e-c52f804ed25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0677d1b1-2e5a-4615-8409-7ed46c414b1f", "tag": "5f802974-a79d-4fc1-8c0e-137e75f2fd38"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:26:59.463148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1ab571af-144d-4eec-adf8-00f9a4ee6bc2 req-a730b5e0-db4a-46b4-a15e-c52f804ed25b service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.464121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1ab571af-144d-4eec-adf8-00f9a4ee6bc2 req-a730b5e0-db4a-46b4-a15e-c52f804ed25b service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.464556 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-1ab571af-144d-4eec-adf8-00f9a4ee6bc2 req-a730b5e0-db4a-46b4-a15e-c52f804ed25b service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.478395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-1ab571af-144d-4eec-adf8-00f9a4ee6bc2 req-a730b5e0-db4a-46b4-a15e-c52f804ed25b service nova] Creating event network-changed:5f802974-a79d-4fc1-8c0e-137e75f2fd38 for instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f on hv-cinder-85501 Aug 29 19:26:59.483599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-1ab571af-144d-4eec-adf8-00f9a4ee6bc2 req-a730b5e0-db4a-46b4-a15e-c52f804ed25b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035555 Aug 29 19:26:59.484254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 395/787] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:26:59.687738 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:59.689141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:59.706668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.708659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.709972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.711110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.712332 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.713668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.871620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:26:59.873059 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:26:59.880685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.881476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.882078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:26:59.883248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:26:59.884168 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:26:59.884782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:00.083216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:00.094366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:00.095885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:00.097274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-16c3e363-3bc4-4f86-baaf-3d81ffe66e5e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1670 microversion: 2.20 time: 0.413988 Aug 29 19:27:00.098378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 393/788] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:26:59 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1670 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:00.104847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:00.106262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:00.115971 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:00.116645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:00.117283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:00.118205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:00.118821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:00.119467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:00.224421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:00.232035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-eb8011af-a368-4250-b126-c969d87c2104 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.365641 Aug 29 19:27:00.246558 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 396/789] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:26:59 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:00.416095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:00.416707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:00.435449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:00.436243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:00.436840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:00.437828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:00.438283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:00.438703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:00.475606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:00.483740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7bd552fb-0b0a-47b9-aa2b-34b489dba065 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.384026 Aug 29 19:27:00.496645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 394/790] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:00 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:00.580326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:00.592269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4c11b855-b1a9-4428-b16c-3031dea3accd tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1512 microversion: 2.1 time: 0.180173 Aug 29 19:27:00.596472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 397/791] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:00 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:01.122678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:01.123265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:01.130647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.131149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.131584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.132319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.132780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.133213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.254123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:01.255474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:01.262417 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.263445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.264161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.265112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.265782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.266416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.284714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:01.297688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:01.300197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:01.305049 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-060a3f6e-9886-4b3c-9b91-4897d3952d19 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.186391 Aug 29 19:27:01.307897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 395/792] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:01 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:01.500362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-d176a085-7dc7-4077-8ffd-bb77cd2fdf99 req-24dfa1ff-2f37-4177-a956-db11ecb4c34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16306477-fb36-40c9-822e-b7ea4ff41dd0", "name": "network-vif-deleted", "tag": "f4f48f8b-94da-4737-981d-26c9f2705370"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:01.511179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d176a085-7dc7-4077-8ffd-bb77cd2fdf99 req-24dfa1ff-2f37-4177-a956-db11ecb4c34f service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.511662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d176a085-7dc7-4077-8ffd-bb77cd2fdf99 req-24dfa1ff-2f37-4177-a956-db11ecb4c34f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.512118 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d176a085-7dc7-4077-8ffd-bb77cd2fdf99 req-24dfa1ff-2f37-4177-a956-db11ecb4c34f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.530954 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-d176a085-7dc7-4077-8ffd-bb77cd2fdf99 req-24dfa1ff-2f37-4177-a956-db11ecb4c34f service nova] Creating event network-vif-deleted:f4f48f8b-94da-4737-981d-26c9f2705370 for instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 on hv-cinder-85501 Aug 29 19:27:01.536985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-d176a085-7dc7-4077-8ffd-bb77cd2fdf99 req-24dfa1ff-2f37-4177-a956-db11ecb4c34f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039835 Aug 29 19:27:01.537573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 396/793] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:27:01.551823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:01.551823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:01.553049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:01.555234 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.555731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.556191 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.556897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.557360 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.557784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.559475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-379a5f48-8f69-41d7-bcce-300104099949 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.310033 Aug 29 19:27:01.576653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 398/794] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:01 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:01.617271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:01.617889 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:01.624152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.624647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.625090 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.625788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.626242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.626667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.660326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:01.660814 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:01.661286 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:01.661736 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lazy-loading 'fault' on Instance uuid 16306477-fb36-40c9-822e-b7ea4ff41dd0 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:27:01.732883 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c994f449c0c45b3b04ba9c96d80a824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9cf517497a40f6baebabe7bc3ea73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:01.741259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-314d3e97-9ffe-45ec-98bb-d6d2914e24da tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 200 len: 1348 microversion: 2.1 time: 0.127944 Aug 29 19:27:01.741834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 399/795] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:01 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 1348 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:01.768784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:01.777150 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-eabd8866-8997-4091-a78d-aef233e686b5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.235419 Aug 29 19:27:01.777710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 397/796] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:01 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:02.330071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:02.330790 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:02.337635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.338272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.338725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.339438 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.339916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.343045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.479202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:02.488141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:02.489780 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:02.491019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fcf156d9-8c69-4a1b-b570-b2401a7e678f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.165031 Aug 29 19:27:02.491693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 400/797] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:02 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:02.548976 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-fcb22ec3-f347-425e-b259-c796f993176a req-42f83fab-851a-430f-aa1f-004caa3982ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b272a17-8d0c-46ec-a9c7-3399b2785ce7", "name": "network-vif-plugged", "status": "completed", "tag": "da59f026-4ad6-4294-8560-85ff077f3af8"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:02.559404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-fcb22ec3-f347-425e-b259-c796f993176a req-42f83fab-851a-430f-aa1f-004caa3982ea service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.559765 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-fcb22ec3-f347-425e-b259-c796f993176a req-42f83fab-851a-430f-aa1f-004caa3982ea service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.560211 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-fcb22ec3-f347-425e-b259-c796f993176a req-42f83fab-851a-430f-aa1f-004caa3982ea service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.572269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-fcb22ec3-f347-425e-b259-c796f993176a req-42f83fab-851a-430f-aa1f-004caa3982ea service nova] Creating event network-vif-plugged:da59f026-4ad6-4294-8560-85ff077f3af8 for instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 on hv-cinder-85501 Aug 29 19:27:02.577071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-fcb22ec3-f347-425e-b259-c796f993176a req-42f83fab-851a-430f-aa1f-004caa3982ea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031827 Aug 29 19:27:02.577923 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 398/798] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:02.584456 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:02.585077 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:02.591623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.592118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.592553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.593253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.593706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.594124 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.743485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:02.751526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-47fcf8d3-04ce-40e2-8957-b44ec5d1de74 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.173643 Aug 29 19:27:02.752187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 401/799] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:02 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:02.769758 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:02.771105 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] [instance: 16306477-fb36-40c9-822e-b7ea4ff41dd0] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:02.777638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.778162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.778532 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.779224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.779672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.780116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.793950 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] HTTP exception thrown: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 could not be found. Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Request method failure captured: Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 HTTP/1.1 Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRJp9_-_ukpqDtQgPhWrT3CIUUElV0Vapv88L_dWgXygzs2dFBZuNKjD7JXoKwxXb_Lwqq4cT-hmQzGIg2O5sLDjogz4v0JxxVhHSTsVP2PwpMriVT_06H8HfgKH1MxXr62D3aZKvRjaj4LUpfK3Tp5nCqfhHA_AnWO5nB3z2IDUJLc Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: fd9cf517497a40f6baebabe7bc3ea73f Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-TestMinimumBasicScenario-1462127863 Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:27:02.795667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fd9cf517497a40f6baebabe7bc3ea73f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fd9cf517497a40f6baebabe7bc3ea73f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fd9cf517497a40f6baebabe7bc3ea73f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fd9cf517497a40f6baebabe7bc3ea73f"}]}] Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-TestMinimumBasicScenario-1462127863 Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: fd9cf517497a40f6baebabe7bc3ea73f Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1462127863 Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-TestMinimumBasicScenario-1462127863-project Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 1c994f449c0c45b3b04ba9c96d80a824 Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-TestMinimumBasicScenario-1462127863-project Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 could not be found. Aug 29 19:27:02.797597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '16306477-fb36-40c9-822e-b7ea4ff41dd0'} Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 could not be found. Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:27:02.798507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 could not be found. Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 could not be found. Aug 29 19:27:02.799979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:27:02.801301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Returning 404 to user: Instance 16306477-fb36-40c9-822e-b7ea4ff41dd0 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:27:02.801301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-55b48022-5a78-4a3f-b999-245865876493 tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0" status: 404 len: 111 microversion: 2.1 time: 0.038546 Aug 29 19:27:02.801301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 399/800] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:02 2022] GET /compute/v2.1/servers/16306477-fb36-40c9-822e-b7ea4ff41dd0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:27:02.801536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:02.801536 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:02.807361 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.807536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ce05c4b7-2d73-4f2e-a946-945aa822542d tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] Calling method '.version_select at 0x7f1fde34b0d0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:02.807876 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.808324 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.809030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:02.809482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:02.810091 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:02.898220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ce05c4b7-2d73-4f2e-a946-945aa822542d tempest-TestMinimumBasicScenario-1462127863 tempest-TestMinimumBasicScenario-1462127863-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-582808485" status: 202 len: 0 microversion: 2.1 time: 0.096200 Aug 29 19:27:02.899179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 400/801] 10.222.0.62 () {58 vars in 1269 bytes} [Mon Aug 29 19:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-582808485 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:27:03.370255 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:03.378064 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e0373fd6-0883-4456-9d59-5943d6cd3f90 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.583372 Aug 29 19:27:03.378631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 402/802] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:02 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:03.516937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:03.517915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:03.529840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:03.530713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:03.531403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:03.532644 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:03.533401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:03.534189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:03.715961 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:03.727841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:03.735773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:03.740737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-66823430-6b69-46cf-a5eb-b1bb75cac67c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.227999 Aug 29 19:27:03.743176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 401/803] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:03 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:03.773592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:03.774527 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:03.781840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:03.782626 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:03.783440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:03.784489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:03.785096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:03.785674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:03.951396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:03.961501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c50fc091-ba93-4757-acf4-fd239fe96e6f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.191768 Aug 29 19:27:03.962100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 403/804] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:03 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:04.400821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:04.401615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:04.412923 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:04.413948 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:04.414583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:04.415593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:04.416149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:04.416647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:04.561085 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:04.570344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a0e57468-3291-4553-9d3d-e668ca94163d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.173794 Aug 29 19:27:04.570916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 402/805] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:04 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:04.777573 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:04.778299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:04.785312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:04.785800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:04.786274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:04.786990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:04.787441 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:04.787930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:04.941957 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:04.951934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:04.953360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:04.954513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-df4931cb-5966-4173-a5b3-d11f31ddb0d7 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.180977 Aug 29 19:27:04.955066 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 404/806] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:04 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:04.982581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:04.983227 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:04.990245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:04.990730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:04.991154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:04.991863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:04.992317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:04.992733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:05.126901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:05.136050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ca9b56df-b118-4a9b-a48c-79d6f66f60a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.157178 Aug 29 19:27:05.141587 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 403/807] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:04 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:05.596041 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:05.596673 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:05.603381 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:05.604457 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:05.605095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:05.606048 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:05.606783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:05.607396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:05.840380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:05.850263 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5a5ccd1b-8a18-429e-a5d1-3da9bd97efc2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.260448 Aug 29 19:27:05.851131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 405/808] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:05 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:06.092316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:06.092316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:06.092316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:06.092316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:06.093711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:06.093711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:06.093711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:06.093711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:06.159338 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:06.166807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:06.166807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:06.168199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:06.168199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:06.168817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:06.169340 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:06.169977 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:06.276491 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:06.285539 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:06.287829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:06.289231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-13e2d9fb-cd8b-4f89-be53-30ceb93fb236 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.316096 Aug 29 19:27:06.289973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 404/809] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:05 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:06.399283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:06.411651 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-09272461-071e-4bf9-b7eb-122fea32f67a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.256019 Aug 29 19:27:06.425902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 406/810] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:06 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:06.875089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:06.875970 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:06.907787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:06.909050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:06.909753 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:06.911976 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:06.912693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:06.913367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:07.219440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:07.233916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6b5e020f-8095-42bf-9a2b-ff6ff406c2cd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.362767 Aug 29 19:27:07.235315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 405/811] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:06 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:07.314981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:07.316219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:07.324352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:07.324859 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:07.325267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:07.325972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:07.326606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:07.327207 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:07.434075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:07.434939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:07.447255 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:07.447762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:07.448212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:07.449107 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:07.449557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:07.449975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:07.474864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:07.598723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:07.607162 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:07.608431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:07.609599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c1c23a0d-c1b3-498a-adac-5b00320c4126 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.298897 Aug 29 19:27:07.610162 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 407/812] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:07 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:07.754000 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:07.764056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ee1ddf18-c4b3-4232-9f69-c065b205f1c9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.333110 Aug 29 19:27:07.770972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 406/813] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:07 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:08.260272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:08.261199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:08.272389 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:08.275591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:08.276287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:08.277191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:08.277973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:08.278445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:08.305842 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:08.460960 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:08.471748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-77d09d1c-a5c4-4598-b8b9-a1325ce2d74a tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.217972 Aug 29 19:27:08.484033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 408/814] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:08 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:08.634257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:08.634805 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:08.641757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:08.642269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:08.642701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:08.643405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:08.644008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:08.644438 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:08.784565 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:08.792185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:08.795958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:08.796809 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:08.800414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:08.801956 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:08.802631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:08.815171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:08.836315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:08.845656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:08.854910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:08.866131 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4777ba38-82e8-4276-ae0e-b861694c5c99 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.226500 Aug 29 19:27:08.878812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 407/815] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:08 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:09.016620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:09.022799 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c13db3ac-cb9d-4c25-94f0-d7ac67f2bd4d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.241893 Aug 29 19:27:09.023411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 409/816] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:08 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:09.496854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:09.497725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:09.505382 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:09.508393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:09.509089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:09.510092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:09.510752 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:09.511418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:09.690323 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:09.703110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0b9b79d2-ff78-406d-b3a2-7abf71285705 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.210202 Aug 29 19:27:09.711654 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 408/817] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:09 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:09.898734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:09.900330 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:09.918852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:09.922304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:09.928257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:09.929581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:09.932240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:09.932973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:10.044041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:10.044852 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:10.055673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:10.056133 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:10.056573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:10.057288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:10.061652 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:10.062104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:10.237931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:10.259539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:10.261990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:10.263492 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-49720d20-76b8-43cc-a3ab-1c432cd4e10a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.375342 Aug 29 19:27:10.283696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 410/818] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:09 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:10.337700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:10.346000 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8f5270a3-4a8f-4f80-81c4-1c18862b1ab2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.305995 Aug 29 19:27:10.346786 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 409/819] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:10 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:10.726969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:10.727594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:10.734530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:10.735063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:10.735538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:10.736341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:10.736754 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:10.737811 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:10.999343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:11.008014 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e34f01f2-9f93-43ef-824d-082a57b60657 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.285795 Aug 29 19:27:11.008687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 411/820] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:10 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:11.291657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:11.292507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:11.299511 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:11.300153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:11.300660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:11.301911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:11.302518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:11.302949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:11.368359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:11.369135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:11.375301 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:11.377157 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:11.377831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:11.378445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:11.379325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:11.379996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:11.380572 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:12.317810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:12.317810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:12.319506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:12.319506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-447bcd72-bddf-4391-92a0-1d3943f3f01d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.726048 Aug 29 19:27:12.319506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 410/821] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:11 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:12.319776 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:12.320181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:12.320181 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:12.320366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f041f284-3510-4de4-b8d8-08eb8d977921 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.675189 Aug 29 19:27:12.320366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 412/822] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:11 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:12.320552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:12.320552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:12.320552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:12.320552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:12.320895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:12.320895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:12.320895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:12.321157 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9c1b10d2-82cc-4740-9476-0ca97814c8ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.227293 Aug 29 19:27:12.321157 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 411/823] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:12 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:13.325681 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:13.326838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:13.326962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:13.327636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:13.333391 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:13.333877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:13.334320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:13.335021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:13.335184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:13.335474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:13.335924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:13.336120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:13.336561 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:13.338632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:13.339084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:13.339512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:13.627406 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:13.636089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-908dd9d0-52a6-4c9c-b3f3-074c2d904e0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.313344 Aug 29 19:27:13.636877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 412/824] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:13 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:13.641941 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:13.642794 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:13.648944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:13.649698 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:13.650235 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:13.651620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:13.652207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:13.652634 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:13.694275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:13.702667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0fe1e053-6c83-48ef-bef8-73615e0fc4ef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1368 microversion: 2.1 time: 0.381973 Aug 29 19:27:13.703920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 413/825] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:13 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:13.847734 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:13.860418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:13.862122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:13.864864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9e1d83a1-be7f-415c-b67e-bcf64fe1f4b8 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.226023 Aug 29 19:27:13.867739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 413/826] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:13 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:14.657760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:14.658532 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:14.665802 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.668874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.668874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.668874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.668874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.669270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.722637 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:14.723953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:14.730708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.731188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.731621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.732346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.732802 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.733217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.890974 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:14.899810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-19b324e9-4137-413d-81c3-1cd589c0351e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.245984 Aug 29 19:27:14.900418 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 414/827] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:14 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:14.905082 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:14.905890 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:14.912677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.913159 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.913812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.914621 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.915086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.915501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.919003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:14.927203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d3fd9793-9b3f-4a9f-a0d5-68248c5b2d96 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1559 microversion: 2.1 time: 0.208427 Aug 29 19:27:14.927916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 414/828] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:14 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:14.952339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:14.952834 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:14.959909 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.960411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.960852 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:14.961559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:14.962010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:14.962426 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:15.079241 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-34c8f2b6-eec9-4814-ba4e-198b6b9f0212 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130725 Aug 29 19:27:15.080189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 415/829] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:27:14 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:15.139920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:15.145930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:15.147500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:15.148743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9aae42a4-8dd6-4783-b817-759453807f1f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.247396 Aug 29 19:27:15.149429 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 415/830] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:14 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:15.922677 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:15.923312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:15.935750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:15.935750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:15.935750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:15.935750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:15.936138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:15.936138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:16.174996 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:16.176818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:16.184466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:16.185227 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:16.186256 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:16.187203 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:16.187893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:16.188272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:16.188837 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:16.199187 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-79d470f7-30c3-4c95-92c9-6a7ad5fdeacc tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.281013 Aug 29 19:27:16.200405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 416/831] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:15 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:16.416592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:16.424761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:16.426775 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:16.427954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fae5884e-1796-45e5-b71f-c7139862daed tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.257043 Aug 29 19:27:16.428749 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 416/832] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:16 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:27:16.581602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-5e598d90-70a9-4c0d-87ce-511fc339ef27 req-076dc68c-fc32-4240-8940-730a98323d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b272a17-8d0c-46ec-a9c7-3399b2785ce7", "tag": "da59f026-4ad6-4294-8560-85ff077f3af8"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:16.591354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-5e598d90-70a9-4c0d-87ce-511fc339ef27 req-076dc68c-fc32-4240-8940-730a98323d92 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:16.591840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-5e598d90-70a9-4c0d-87ce-511fc339ef27 req-076dc68c-fc32-4240-8940-730a98323d92 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:16.592298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-5e598d90-70a9-4c0d-87ce-511fc339ef27 req-076dc68c-fc32-4240-8940-730a98323d92 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:16.607967 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-5e598d90-70a9-4c0d-87ce-511fc339ef27 req-076dc68c-fc32-4240-8940-730a98323d92 service nova] Creating event network-changed:da59f026-4ad6-4294-8560-85ff077f3af8 for instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 on hv-cinder-85501 Aug 29 19:27:16.610850 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-5e598d90-70a9-4c0d-87ce-511fc339ef27 req-076dc68c-fc32-4240-8940-730a98323d92 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032878 Aug 29 19:27:16.612729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 417/833] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:17.221230 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:17.221774 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:17.228841 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:17.229326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:17.229754 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:17.230448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:17.230904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:17.231367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:17.374663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:17.382473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-90623102-948d-47eb-9d94-464b5505585b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.165049 Aug 29 19:27:17.383047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 417/834] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:17 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:17.452240 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:17.452934 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:17.461463 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:17.461686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:17.462109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:17.463008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:17.463459 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:17.464056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:17.646936 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:17.656356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:17.657810 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:17.658964 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c4d22d3b-a835-4a64-9eac-d8e9d1c02587 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.211701 Aug 29 19:27:17.660047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 418/835] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:17 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:18.403098 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:18.403803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:18.412707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:18.413713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:18.414784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:18.416283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:18.417002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:18.417647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:18.595801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:18.604614 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-74682a20-0243-479e-bad5-d5c1dcbbcae7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.205564 Aug 29 19:27:18.605110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 418/836] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:18 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:18.682617 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:18.683280 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:18.689864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:18.690470 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:18.690980 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:18.691739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:18.692339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:18.692773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:18.833489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:18.841624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:18.843061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:18.844245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6ad9b8f3-a63f-442c-93e5-ac4a96a8c7e6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.165696 Aug 29 19:27:18.844795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 419/837] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:18 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:19.626484 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:19.627078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:19.633537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:19.634013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:19.634447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:19.635135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:19.635589 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:19.636045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:19.769155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:19.777656 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e2e2bd94-2344-435a-8f26-1e011dee4fa6 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1571 microversion: 2.1 time: 0.155005 Aug 29 19:27:19.778216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 419/838] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:19 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:19.798119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:19.798712 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:19.805072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:19.805551 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:19.805986 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:19.806661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:19.807108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:19.807526 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:19.837693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121336) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:27:19.867608 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:19.874415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:19.874415 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:19.874924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:19.875375 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:19.876083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:19.876685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:19.877122 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:20.013383 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:20.021599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:20.022958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:20.024121 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-117c017c-23a4-4afb-ae2a-54cfb1480c7f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.161393 Aug 29 19:27:20.025297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 420/839] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:19 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:20.177885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9208a08a-a7e2-4daa-ab48-ecb2dfc376be tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "POST /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742/action" status: 202 len: 0 microversion: 2.1 time: 0.383802 Aug 29 19:27:20.178699 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 420/840] 10.222.0.62 () {60 vars in 1278 bytes} [Mon Aug 29 19:27:19 2022] POST /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:27:20.186453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:20.187053 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:20.193733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:20.194242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:20.194679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:20.195374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:20.195818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:20.196637 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:20.337615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:20.345516 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b05212ad-3854-400e-bcac-70910e28109e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1519 microversion: 2.1 time: 0.162813 Aug 29 19:27:20.346080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 421/841] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:20 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:20.537063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-962ff799-4a05-455c-bffd-140f50b51a2a req-6b99f6ff-77c9-45c3-881b-4481fa12da95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "name": "network-vif-plugged", "status": "completed", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:20.552179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-962ff799-4a05-455c-bffd-140f50b51a2a req-6b99f6ff-77c9-45c3-881b-4481fa12da95 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:20.552179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-962ff799-4a05-455c-bffd-140f50b51a2a req-6b99f6ff-77c9-45c3-881b-4481fa12da95 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:20.552179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-962ff799-4a05-455c-bffd-140f50b51a2a req-6b99f6ff-77c9-45c3-881b-4481fa12da95 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:20.560268 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-962ff799-4a05-455c-bffd-140f50b51a2a req-6b99f6ff-77c9-45c3-881b-4481fa12da95 service nova] Creating event network-vif-plugged:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:27:20.565354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-962ff799-4a05-455c-bffd-140f50b51a2a req-6b99f6ff-77c9-45c3-881b-4481fa12da95 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Aug 29 19:27:20.566148 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 421/842] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:21.047670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:21.049026 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:21.056553 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:21.057258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:21.057779 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:21.059292 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:21.060028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:21.060459 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:21.198925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:21.204319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:21.205740 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:21.206897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-90cb4785-b69a-4ea7-8e5a-00e6b61b457e tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.163641 Aug 29 19:27:21.208160 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 422/843] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:21 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:21.367531 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:21.368260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:21.375558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:21.376076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:21.376506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:21.377199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:21.377700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:21.378118 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:21.519586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:21.527602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-04cd4214-cfe7-4d43-b208-871252019414 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1519 microversion: 2.1 time: 0.164326 Aug 29 19:27:21.528195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 422/844] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:21 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:22.230698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:22.231313 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:22.237868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:22.238363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:22.239409 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:22.241291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:22.241763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:22.242220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:22.385960 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:22.386195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:22.387450 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:22.388633 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-38ff0945-6648-44be-aad3-f31180e686e3 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.161874 Aug 29 19:27:22.389178 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 423/845] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:22 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:27:22.548773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:22.549407 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:22.556217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:22.556706 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:22.557137 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:22.557843 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:22.558290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:22.558712 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:22.585540 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-63ce070c-b012-49e7-84d5-45fbd6a66a17 req-6ff19621-2d82-4fbf-a712-d045b9d087b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "name": "network-vif-unplugged", "status": "completed", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:22.597272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-63ce070c-b012-49e7-84d5-45fbd6a66a17 req-6ff19621-2d82-4fbf-a712-d045b9d087b3 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:22.597843 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-63ce070c-b012-49e7-84d5-45fbd6a66a17 req-6ff19621-2d82-4fbf-a712-d045b9d087b3 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:22.598280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-63ce070c-b012-49e7-84d5-45fbd6a66a17 req-6ff19621-2d82-4fbf-a712-d045b9d087b3 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:22.610287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.compute.server_external_events [req-63ce070c-b012-49e7-84d5-45fbd6a66a17 req-6ff19621-2d82-4fbf-a712-d045b9d087b3 service nova] Unable to find a host for instance fdf00998-1f50-44db-b548-fe6bc04f5742. Dropping event network-vif-unplugged {{(pid=121337) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 19:27:22.611270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-63ce070c-b012-49e7-84d5-45fbd6a66a17 req-6ff19621-2d82-4fbf-a712-d045b9d087b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030066 Aug 29 19:27:22.611975 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 424/846] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 19:27:22.699589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:22.702075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:22.709054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-058e2e6b-0825-49fa-9ad1-b40b2a8e31d5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1521 microversion: 2.1 time: 0.164098 Aug 29 19:27:22.709772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 423/847] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:22 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:23.412480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:23.413085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:23.419656 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:23.420164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:23.420597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:23.421284 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:23.421741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:23.422154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:23.555166 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:23.559646 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=100 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:23.564538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:23.565917 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:23.567575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b2f46086-3bcc-451a-8fd7-268f5f999005 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1728 microversion: 2.20 time: 0.159581 Aug 29 19:27:23.568166 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 425/848] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:23 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:23.730784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:23.731400 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:23.739460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:23.739969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:23.740403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:23.741098 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:23.741559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:23.741978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:23.888194 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:23.896334 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4b7f8d18-9d31-49ef-a40e-8971452431a0 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1521 microversion: 2.1 time: 0.169668 Aug 29 19:27:23.896910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 424/849] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:23 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:24.593251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:24.593810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:24.600895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:24.601377 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:24.601810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:24.602500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:24.602951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:24.603376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:24.738904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:24.747090 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:24.748578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:24.749872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-59a45120-462c-4062-8a25-648fe150c7f5 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1715 microversion: 2.20 time: 0.161061 Aug 29 19:27:24.750435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 426/850] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:27:24 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:27:24.916631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:24.917358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:24.924433 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:24.924912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:24.925341 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:24.926030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:24.926477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:24.926895 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:25.167770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:25.176316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c36dc4e7-f17e-47ae-865d-bad4e5534a02 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.262967 Aug 29 19:27:25.176903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 425/851] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:24 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:26.197357 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:26.197965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:26.204486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:26.204964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:26.205398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:26.206083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:26.206534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:26.207453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:26.341136 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:26.349035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5f57d1c3-4a7c-47bb-9ddf-6bd14d3bebfa tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.155531 Aug 29 19:27:26.349592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 427/852] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:26 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:27.370659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:27.371255 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:27.373736 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:27.379337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:27.379811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:27.386583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:27.386583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:27.386583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:27.386583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:27.519176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:27.527116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1327769a-5c3d-443c-a6ed-3923a8b89750 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.160258 Aug 29 19:27:27.527968 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 426/853] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:27 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:28.548972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:28.549600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:28.556491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:28.556965 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:28.557402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:28.558085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:28.558618 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:28.558992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:28.689252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:28.697798 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-defb8674-f761-47d6-952b-1f4710bee1ac tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.152729 Aug 29 19:27:28.698356 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 428/854] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:28 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:27:29.720509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:29.721150 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:29.728475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:29.728962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:29.729394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:29.730098 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:29.730557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:29.731011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:29.866175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:29.874389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-70e98296-b11f-4aeb-b296-6ae267fe6b0b tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.157786 Aug 29 19:27:29.874962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 427/855] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:29 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:30.896451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:30.897049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:30.903523 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:30.904035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:30.904465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:30.905154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:30.905600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:30.906017 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:31.042501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:31.050155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bfb3f902-f05d-4e48-8b0b-cf17b9270802 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.158330 Aug 29 19:27:31.050756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 429/856] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:30 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:32.071633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:32.072295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:32.078782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:32.079266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:32.079697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:32.080415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:32.080868 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:32.081289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:32.217428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:32.226284 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5ed26fb4-b38b-4e00-beb1-5a552a6ab68d tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.158548 Aug 29 19:27:32.226888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 428/857] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:32 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:33.247368 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:33.247973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:33.254598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:33.255072 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:33.255501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:33.256223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:33.256677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:33.257100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:33.391909 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:33.400424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a82dbaea-8601-4382-b898-9681605bc0d2 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.157032 Aug 29 19:27:33.400998 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 430/858] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:33 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:34.423436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:34.423839 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:34.430902 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:34.431368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:34.431801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:34.432524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:34.432976 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:34.433400 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:34.567197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:34.575025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-98dbb7a6-ccfa-45f1-bdd1-383b1e64c812 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.155789 Aug 29 19:27:34.575625 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 429/859] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:34 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:35.596653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:35.597797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:35.604596 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:35.605080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:35.605512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:35.606255 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:35.606705 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:35.607150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:35.739206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:35.746945 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2cfb9cee-360d-4072-81f1-16cf62a24275 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.154112 Aug 29 19:27:35.747502 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 431/860] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:35 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:36.670405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-882a3c04-e880-490b-8ec8-c15686e55dbc req-73df9919-2416-4c04-af0e-789d97c39e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "name": "network-vif-plugged", "status": "completed", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:36.680884 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-882a3c04-e880-490b-8ec8-c15686e55dbc req-73df9919-2416-4c04-af0e-789d97c39e46 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:36.681982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-882a3c04-e880-490b-8ec8-c15686e55dbc req-73df9919-2416-4c04-af0e-789d97c39e46 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:36.681982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-882a3c04-e880-490b-8ec8-c15686e55dbc req-73df9919-2416-4c04-af0e-789d97c39e46 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:36.693176 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-882a3c04-e880-490b-8ec8-c15686e55dbc req-73df9919-2416-4c04-af0e-789d97c39e46 service nova] Creating event network-vif-plugged:d83b4120-aa4e-498d-b627-3c7df3272a2d for instance fdf00998-1f50-44db-b548-fe6bc04f5742 on hv-cinder-85501 Aug 29 19:27:36.698121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-882a3c04-e880-490b-8ec8-c15686e55dbc req-73df9919-2416-4c04-af0e-789d97c39e46 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031599 Aug 29 19:27:36.698700 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 430/861] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:36.768184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:36.768782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:36.775579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:36.776112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:36.776551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:36.777287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:36.777750 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:36.778281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:36.918871 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:36.927629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-693e1f41-9a89-4570-8af8-68db1b843580 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.163377 Aug 29 19:27:36.928531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 432/862] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:36 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:37.954631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:37.955363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:37.961609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:37.962097 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:37.962531 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:37.963226 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:37.963685 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:37.964140 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:38.100935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:38.108739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bbabdac6-afeb-4190-8e61-59efc5b653c1 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.159014 Aug 29 19:27:38.109307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 431/863] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:37 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:39.130697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:39.131301 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:39.138096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:39.138659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:39.139093 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:39.139787 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:39.140364 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:39.140784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:39.276891 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:39.285209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5a295e71-eaec-4f8a-aa83-8c4e8db1bf4c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1577 microversion: 2.1 time: 0.157902 Aug 29 19:27:39.285780 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 433/864] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:39 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:40.306730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:40.307275 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:40.313751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:40.314233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:40.314666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:40.315362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:40.315821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:40.316304 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:40.450447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:27:40.458901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-321b0535-0bfa-46a2-b627-70b09868f03f tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1564 microversion: 2.1 time: 0.156174 Aug 29 19:27:40.459462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 432/865] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:27:40 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:27:43.567986 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:43.568542 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:43.570447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=44 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:43.575116 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:43.575657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:43.576155 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:43.581054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:43.581054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:43.581054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:43.603563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-44efa7ca-b0de-4593-97a1-90c228db01ea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/ips" status: 200 len: 146 microversion: 2.1 time: 0.152605 Aug 29 19:27:43.609598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 434/866] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:27:43 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/ips => generated 146 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:46.328538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d08ed5e-55fd-488d-a264-fd89b0ad7c14"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:46.330851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:46.336879 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:46.337362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:46.337787 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:46.338507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:46.338962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:46.339579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:47.425186 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e5b9e5fe-3ad3-483d-a46d-f7e0021ae779 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.100693 Aug 29 19:27:47.428603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 433/867] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:27:46 2022] POST /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments => generated 194 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:56.020496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:56.022709 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:56.025817 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=52 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:56.031954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:56.032439 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:56.032870 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:56.033568 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:56.034874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:56.035261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:56.065538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c57bd6c8-d173-4e38-a80b-225de56bea1f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049482 Aug 29 19:27:56.066101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 435/868] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:27:56 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:56.078056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:27:56.078622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:56.085313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:56.085804 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:56.086236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:56.086928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:56.087383 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:56.087806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:56.091719 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:56.118029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-878fcd5d-e597-4242-8647-3b1701d05c09 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/9d08ed5e-55fd-488d-a264-fd89b0ad7c14" status: 200 len: 194 microversion: 2.1 time: 0.045038 Aug 29 19:27:56.118620 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 434/869] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Aug 29 19:27:56 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/9d08ed5e-55fd-488d-a264-fd89b0ad7c14 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:27:57.848753 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8584df6b-b2c6-46a5-965e-1d5332cdc6ad"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:27:57.851034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:27:57.858116 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:57.858596 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:57.859025 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:57.859718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:27:57.860188 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:27:57.860603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:27:58.844868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8dfaa3b6-d6a8-403c-a639-360812f5fbc4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "POST /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.000353 Aug 29 19:27:58.845457 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 436/870] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:27:57 2022] POST /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:03.335143 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:03.335670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:03.338083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=18 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:03.343632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:03.344218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:03.344573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:03.345266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:03.345716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:03.346886 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:03.372494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c91b6f3f-2102-4e39-8e32-c1c43ba50503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/ips" status: 200 len: 150 microversion: 2.1 time: 0.041961 Aug 29 19:28:03.373053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 435/871] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:28:03 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:05.550820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40343ba3-e878-47ee-9885-1a5ed8de7621"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:05.553233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:05.559374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:05.559880 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:05.560329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:05.561066 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:05.561520 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:05.561943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:06.619076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-aada963d-c8f4-44b3-b91f-bfbb1be5f23a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.073412 Aug 29 19:28:06.619753 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 437/872] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:28:05 2022] POST /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments => generated 194 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:07.047222 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:07.058258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:07.058258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.058258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.058258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.058990 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.060149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.060149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.094983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f52178fc-ae18-4bb5-9b1d-e1a4947e5805 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051754 Aug 29 19:28:07.095841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 436/873] 10.222.0.62 () {60 vars in 1343 bytes} [Mon Aug 29 19:28:07 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:07.161661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:07.162272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:07.169253 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.169771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.170215 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.170934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.171385 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.171837 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.198835 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:28:07.439493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:07.443037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:07.450525 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.451021 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.451458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.452395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.452933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.453358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.485074 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-90a40088-c015-400e-be77-3bccb6596752 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050414 Aug 29 19:28:07.485701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 437/874] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:28:07 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:28:07.537632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2da71e01-a5a4-459d-b64a-db94bccab50a tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 204 len: 0 microversion: 2.20 time: 0.380074 Aug 29 19:28:07.538223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 438/875] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 19:28:07 2022] DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:28:07.546480 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:07.547083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:07.553897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.554371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.554798 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.555497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.555960 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.556380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.646503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:07.647140 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:07.653310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.653800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.654236 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.654938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.655390 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.655841 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.686409 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0df9252a-4f7f-4410-95f0-173eb2926d21 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/9d08ed5e-55fd-488d-a264-fd89b0ad7c14" status: 200 len: 194 microversion: 2.1 time: 0.044110 Aug 29 19:28:07.687307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 439/876] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Aug 29 19:28:07 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/9d08ed5e-55fd-488d-a264-fd89b0ad7c14 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:28:07.690399 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:07.697897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:07.698159 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:07.700229 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:07.701719 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:07.702932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a8c6cd88-feec-4c8f-a286-f3ecf8abfb90 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.160265 Aug 29 19:28:07.705905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 438/877] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:07 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:28:07.706055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.706055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.706055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.706055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:07.710895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:07.710895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:07.789530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lazy-loading 'services' on Instance uuid 0677d1b1-2e5a-4615-8409-7ed46c414b1f {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:28:08.035197 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3c7508ce-2367-4be1-b148-6b9882a40098 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/9d08ed5e-55fd-488d-a264-fd89b0ad7c14" status: 202 len: 0 microversion: 2.1 time: 0.341610 Aug 29 19:28:08.035790 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 440/878] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:28:07 2022] DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/9d08ed5e-55fd-488d-a264-fd89b0ad7c14 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:28:08.726747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:08.727341 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:08.733927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:08.734414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:08.734862 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:08.735588 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:08.736072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:08.736998 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:08.871146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:08.880073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:08.881511 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:08.882661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8255e0c1-1d0d-4e8e-8d27-59678c2fb17c tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1721 microversion: 2.20 time: 0.159980 Aug 29 19:28:08.883213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 439/879] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:08 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:28:09.906837 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:09.907661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:09.913810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:09.914287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:09.914715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:09.915398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:09.915861 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:09.916287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:10.166825 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:10.176130 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:10.177762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:10.178936 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-65d195e5-30aa-4a6e-a69c-890c40507149 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1655 microversion: 2.20 time: 0.276810 Aug 29 19:28:10.179490 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 441/880] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:09 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1655 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:28:10.351915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-45e1b4f1-d477-45b9-bc2e-12289e6f51be req-7cf1475e-1e5d-47b0-90fe-831be649741c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d63dea-430c-4573-82f6-68d0b0e24fea", "name": "network-vif-deleted", "tag": "4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:10.362582 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-45e1b4f1-d477-45b9-bc2e-12289e6f51be req-7cf1475e-1e5d-47b0-90fe-831be649741c service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:10.363319 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-45e1b4f1-d477-45b9-bc2e-12289e6f51be req-7cf1475e-1e5d-47b0-90fe-831be649741c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:10.363978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-45e1b4f1-d477-45b9-bc2e-12289e6f51be req-7cf1475e-1e5d-47b0-90fe-831be649741c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:10.376589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-45e1b4f1-d477-45b9-bc2e-12289e6f51be req-7cf1475e-1e5d-47b0-90fe-831be649741c service nova] Creating event network-vif-deleted:4f0b3d56-bd6f-4ff6-81c2-8055ed097fe9 for instance 36d63dea-430c-4573-82f6-68d0b0e24fea on hv-cinder-85501 Aug 29 19:28:10.382456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-45e1b4f1-d477-45b9-bc2e-12289e6f51be req-7cf1475e-1e5d-47b0-90fe-831be649741c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Aug 29 19:28:10.384011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 440/881] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:28:11.205266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:11.205865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:11.212551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:11.213036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:11.213471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:11.214162 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:11.214614 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:11.215035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:11.248946 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:11.249428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:11.249854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:11.250300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lazy-loading 'fault' on Instance uuid 36d63dea-430c-4573-82f6-68d0b0e24fea {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:28:11.298371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:11.307795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:11.309625 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74bfde91bf944824bdae8207641a08b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de427c8638c049d3ad809158b0ccc0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:11.310950 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6fbf2214-4fdd-42bd-ab66-83bb604d5bdd tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 200 len: 1372 microversion: 2.20 time: 0.109755 Aug 29 19:28:11.311493 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 442/882] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:11 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:28:12.334093 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:12.334797 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:12.342220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:12.342978 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:12.343465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:12.344260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:12.344739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:12.345270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:12.360302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] HTTP exception thrown: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Request method failure captured: Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea HTTP/1.1 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGSUc4-2cnOcOgL1RsIYABYhQVFu3inGp8AxasWz0YMbiFhcn03mzFiRIKww6B2VQ5HYtJI-jeIeSyMCOwc1uC9WDSzq-oVdPI9MrfMM0wa7yjNheU7X3rgHtum0JK53BSSHLkcMBbq5lrio9LIDKROyGYirdi5Zkpa_4vB2uKOD1U Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:12.362710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de427c8638c049d3ad809158b0ccc0d2"}]}] Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 74bfde91bf944824bdae8207641a08b7 Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:12.364762 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '36d63dea-430c-4573-82f6-68d0b0e24fea'} Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:12.365727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:12.367249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:12.368642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Returning 404 to user: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:12.368642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-afce72a2-6efe-433e-b915-030c0ce21429 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 404 len: 111 microversion: 2.20 time: 0.035141 Aug 29 19:28:12.368642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 441/883] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:12 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:28:12.373631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-872b9de6-c3de-4a3a-b216-097c7fce074f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '.version_select at 0x7f1fe1d87820>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:12.470560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-872b9de6-c3de-4a3a-b216-097c7fce074f tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599461889" status: 204 len: 0 microversion: 2.20 time: 0.100768 Aug 29 19:28:12.471743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 443/884] 10.222.0.62 () {60 vars in 1262 bytes} [Mon Aug 29 19:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599461889 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:28:14.602732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:14.603237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:14.610095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:14.610579 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:14.611123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:14.612324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:14.612779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:14.613446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:14.627248 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] HTTP exception thrown: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Request method failure captured: Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea HTTP/1.1 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGSUc4-2cnOcOgL1RsIYABYhQVFu3inGp8AxasWz0YMbiFhcn03mzFiRIKww6B2VQ5HYtJI-jeIeSyMCOwc1uC9WDSzq-oVdPI9MrfMM0wa7yjNheU7X3rgHtum0JK53BSSHLkcMBbq5lrio9LIDKROyGYirdi5Zkpa_4vB2uKOD1U Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:14.628814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de427c8638c049d3ad809158b0ccc0d2"}]}] Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 74bfde91bf944824bdae8207641a08b7 Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.630486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '36d63dea-430c-4573-82f6-68d0b0e24fea'} Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:14.631392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.637783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.639288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Returning 404 to user: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:14.639288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5e65a7ca-7c3f-4b3e-a78e-008fc7a4645d tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 404 len: 111 microversion: 2.20 time: 0.031421 Aug 29 19:28:14.639288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 442/885] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 19:28:14 2022] DELETE /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:28:14.644073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:14.644708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: 36d63dea-430c-4573-82f6-68d0b0e24fea] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:14.651661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:14.652222 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:14.652765 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:14.653570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:14.654080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:14.654508 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:14.668931 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] HTTP exception thrown: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Request method failure captured: Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea HTTP/1.1 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGSUc4-2cnOcOgL1RsIYABYhQVFu3inGp8AxasWz0YMbiFhcn03mzFiRIKww6B2VQ5HYtJI-jeIeSyMCOwc1uC9WDSzq-oVdPI9MrfMM0wa7yjNheU7X3rgHtum0JK53BSSHLkcMBbq5lrio9LIDKROyGYirdi5Zkpa_4vB2uKOD1U Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:14.670635 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de427c8638c049d3ad809158b0ccc0d2"}]}] Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 74bfde91bf944824bdae8207641a08b7 Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.672378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '36d63dea-430c-4573-82f6-68d0b0e24fea'} Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:14.673262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. Aug 29 19:28:14.674828 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:14.676144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Returning 404 to user: Instance 36d63dea-430c-4573-82f6-68d0b0e24fea could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:14.676144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0a4f8a3f-8320-473b-b1ce-64fe57420df6 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea" status: 404 len: 111 microversion: 2.20 time: 0.033215 Aug 29 19:28:14.676144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 444/886] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:14 2022] GET /compute/v2.1/servers/36d63dea-430c-4573-82f6-68d0b0e24fea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:28:16.005467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:16.006132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:16.012661 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:16.013141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:16.013572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:16.014266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:16.014795 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:16.015218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:16.029568 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] HTTP exception thrown: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Request method failure captured: Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 HTTP/1.1 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRGSUc4-2cnOcOgL1RsIYABYhQVFu3inGp8AxasWz0YMbiFhcn03mzFiRIKww6B2VQ5HYtJI-jeIeSyMCOwc1uC9WDSzq-oVdPI9MrfMM0wa7yjNheU7X3rgHtum0JK53BSSHLkcMBbq5lrio9LIDKROyGYirdi5Zkpa_4vB2uKOD1U Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:16.031109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de427c8638c049d3ad809158b0ccc0d2"}]}] Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 74bfde91bf944824bdae8207641a08b7 Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.033366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'db903f97-8e2a-428c-a4d8-64321853b802'} Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:16.034508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.035915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.037108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Returning 404 to user: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:16.037108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-66c5b746-ba97-4762-a8dd-e0f607805290 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 404 len: 111 microversion: 2.20 time: 0.031168 Aug 29 19:28:16.037108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 443/887] 10.222.0.62 () {60 vars in 1280 bytes} [Mon Aug 29 19:28:16 2022] DELETE /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:28:16.042280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:16.048085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] [instance: db903f97-8e2a-428c-a4d8-64321853b802] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:16.050442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:16.050932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:16.051367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:16.052193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:16.052647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:16.053099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:16.067371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] HTTP exception thrown: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Request method failure captured: Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 HTTP/1.1 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRGSUc4-2cnOcOgL1RsIYABYhQVFu3inGp8AxasWz0YMbiFhcn03mzFiRIKww6B2VQ5HYtJI-jeIeSyMCOwc1uC9WDSzq-oVdPI9MrfMM0wa7yjNheU7X3rgHtum0JK53BSSHLkcMBbq5lrio9LIDKROyGYirdi5Zkpa_4vB2uKOD1U Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:16.069020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/de427c8638c049d3ad809158b0ccc0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_de427c8638c049d3ad809158b0ccc0d2"}]}] Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: de427c8638c049d3ad809158b0ccc0d2 Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1969480315 Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 74bfde91bf944824bdae8207641a08b7 Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1969480315-project Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.070659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'db903f97-8e2a-428c-a4d8-64321853b802'} Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:16.071529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. Aug 29 19:28:16.073000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:16.074411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] Returning 404 to user: Instance db903f97-8e2a-428c-a4d8-64321853b802 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:16.074411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-17172573-4d2d-4893-8b42-f424db554116 tempest-AttachVolumeShelveTestJSON-1969480315 tempest-AttachVolumeShelveTestJSON-1969480315-project] 10.222.0.62 "GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802" status: 404 len: 111 microversion: 2.20 time: 0.031984 Aug 29 19:28:16.074411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 445/888] 10.222.0.62 () {60 vars in 1277 bytes} [Mon Aug 29 19:28:16 2022] GET /compute/v2.1/servers/db903f97-8e2a-428c-a4d8-64321853b802 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:28:16.289829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cddcc59e-7a5e-4b51-b908-35b254cb9f72 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: .version_select at 0x7f1fde2b3d30>, body: {"keypair": {"name": "tempest-keypair-1363864953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Be+dMIOsfVp6vpaLQ0XneaAuau/9Ao2C6GphWubmttVKc121n1hIU0iehNR9+Y6rbvQsIvsaANdbya3pyOxNMwrxK4CrUEXLdo/KYQ2d7rJclBkVJOMquTb8wywAsGA=="}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:16.305473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-cddcc59e-7a5e-4b51-b908-35b254cb9f72 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:28:16.309939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-cddcc59e-7a5e-4b51-b908-35b254cb9f72 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:28:16.430761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cddcc59e-7a5e-4b51-b908-35b254cb9f72 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145191 Aug 29 19:28:16.431370 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 444/889] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:28:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:17.650488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:17.651100 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:17.657771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:17.658899 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:17.659537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:17.660269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:17.660725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:17.661148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:17.692879 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1be9f01b-652e-4841-bfac-ba2678332291 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/8584df6b-b2c6-46a5-965e-1d5332cdc6ad" status: 200 len: 194 microversion: 2.1 time: 0.046296 Aug 29 19:28:17.693794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 446/890] 10.222.0.62 () {58 vars in 1413 bytes} [Mon Aug 29 19:28:17 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/8584df6b-b2c6-46a5-965e-1d5332cdc6ad => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:17.706116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:17.707254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:17.715271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:17.716955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:17.716955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:17.717775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:17.718294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:17.718938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:17.806020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lazy-loading 'services' on Instance uuid 0677d1b1-2e5a-4615-8409-7ed46c414b1f {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:28:18.134337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6e72f76a-d6d6-480c-b521-f165ff011006 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/8584df6b-b2c6-46a5-965e-1d5332cdc6ad" status: 202 len: 0 microversion: 2.1 time: 0.433523 Aug 29 19:28:18.135188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 445/891] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:28:17 2022] DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments/8584df6b-b2c6-46a5-965e-1d5332cdc6ad => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:28:19.655301 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-372856706", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8927a541-9264-4ca6-885d-504e7408d7ca"}], "security_groups": [{"name": "tempest-securitygroup--1283426388"}], "key_name": "tempest-keypair-1363864953", "user_data": "}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:19.802812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] validate_networks() for [('8927a541-9264-4ca6-885d-504e7408d7ca', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:28:20.417840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:20.422577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:20.432038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.432559 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.433004 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.433732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.434262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.434746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.474236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fa872bae-4eeb-4f02-b845-7ca796ebadea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060675 Aug 29 19:28:20.474877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 446/892] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:28:20 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:28:20.523662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:28:20.524291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:28:20.524760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:28:20.525158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:28:20.525689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:28:20.535351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.536600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.536600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.537009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.537457 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.537874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.554830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:28:20.558788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:28:20.570744 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:28:20.573056 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:28:20.598169 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:20.604072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:20.608713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.609207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.609642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.610392 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.610849 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.611308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.644293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a139bca2-fcf4-43bf-b4ae-bb2ea4053fea tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050395 Aug 29 19:28:20.644965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 447/893] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:28:20 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:28:20.709562 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:20.710056 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:20.716158 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.716637 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.717071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.718178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:20.718178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:20.718613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:20.720068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-025d771c-a15b-40b3-8a59-486ec5b3bc70 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.069118 Aug 29 19:28:20.726937 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 447/894] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:28:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:28:20.732231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-71089e18-665e-4851-b481-5a165c9e9b66 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:20.733488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-71089e18-665e-4851-b481-5a165c9e9b66 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:20.756185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:28:20.798985 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-71089e18-665e-4851-b481-5a165c9e9b66 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:20.806597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-71089e18-665e-4851-b481-5a165c9e9b66 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1241 microversion: 2.1 time: 0.078327 Aug 29 19:28:20.807156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 448/895] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:20 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:21.069049 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-cab1ac74-28a9-476a-84ab-d4d6e56f6e7d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 204 len: 0 microversion: 2.1 time: 0.362972 Aug 29 19:28:21.070847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 448/896] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:28:20 2022] DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:28:21.078294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:21.079125 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:21.085116 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:21.085598 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:21.086030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:21.086719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:21.087172 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:21.087590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:21.288550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:21.296959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4a4ae18c-20b3-4b23-9857-6a41aac915b2 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1674 microversion: 2.1 time: 0.222596 Aug 29 19:28:21.297623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 449/897] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:21 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:21.829318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3ccfc45c-129c-4959-b372-7da67baf6218 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:21.830523 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3ccfc45c-129c-4959-b372-7da67baf6218 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:21.893375 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3ccfc45c-129c-4959-b372-7da67baf6218 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:21.900411 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3ccfc45c-129c-4959-b372-7da67baf6218 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1241 microversion: 2.1 time: 0.075338 Aug 29 19:28:21.900995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 449/898] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:21 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:28:22.319127 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:22.319734 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:22.326280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:22.326788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:22.327221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:22.327933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:22.328388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:22.328812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:22.332941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:22.461861 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:22.469359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4e00868f-9d30-4013-b2e9-92d31358c5e9 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1674 microversion: 2.1 time: 0.154143 Aug 29 19:28:22.469913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 450/899] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:22 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:22.922548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:22.923766 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:22.932747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:22.932747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:22.933257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:22.934344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:22.935079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:22.935686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:23.013213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:23.021535 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bd7a3f9c-a7e6-49c9-aa9b-444773a3759b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1245 microversion: 2.1 time: 0.104008 Aug 29 19:28:23.032654 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 450/900] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:22 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:23.491111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:23.491762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:23.499791 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:23.503954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:23.503954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:23.503954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:23.503954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:23.504321 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:23.714436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:23.723418 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-495ec91f-6527-43b9-91c3-b92b52f3b39f tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1674 microversion: 2.1 time: 0.237139 Aug 29 19:28:23.724299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 451/901] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:23 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:24.044401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:24.045529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:24.053844 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:24.054659 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:24.055310 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:24.056196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:24.056981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:24.057605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:24.141220 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:24.151458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-56d80e71-c274-4949-9e55-01dc00c5aa98 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1293 microversion: 2.1 time: 0.112341 Aug 29 19:28:24.152250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 451/902] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:24 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:24.263607 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-8a97b6a0-1940-4bdd-af5e-49aaaa649a47 req-0aa0b65c-7f64-4092-9521-be9594ce475e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0677d1b1-2e5a-4615-8409-7ed46c414b1f", "name": "network-vif-deleted", "tag": "5f802974-a79d-4fc1-8c0e-137e75f2fd38"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:24.276744 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8a97b6a0-1940-4bdd-af5e-49aaaa649a47 req-0aa0b65c-7f64-4092-9521-be9594ce475e service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:24.277218 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8a97b6a0-1940-4bdd-af5e-49aaaa649a47 req-0aa0b65c-7f64-4092-9521-be9594ce475e service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:24.277803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8a97b6a0-1940-4bdd-af5e-49aaaa649a47 req-0aa0b65c-7f64-4092-9521-be9594ce475e service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:24.309571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-8a97b6a0-1940-4bdd-af5e-49aaaa649a47 req-0aa0b65c-7f64-4092-9521-be9594ce475e service nova] Creating event network-vif-deleted:5f802974-a79d-4fc1-8c0e-137e75f2fd38 for instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f on hv-cinder-85501 Aug 29 19:28:24.309571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-8a97b6a0-1940-4bdd-af5e-49aaaa649a47 req-0aa0b65c-7f64-4092-9521-be9594ce475e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052300 Aug 29 19:28:24.313373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 452/903] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:24.757726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:24.758334 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:24.768604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:24.769111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:24.769544 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:24.770253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:24.770706 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:24.771127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:24.854565 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:24.863660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-90592141-aa5c-4349-b686-37ae4ed5b2b8 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1323 microversion: 2.1 time: 0.109551 Aug 29 19:28:24.864366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 452/904] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:24 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1323 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:25.191083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:25.191452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:25.199115 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:25.199607 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:25.200072 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:25.201089 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:25.201541 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:25.201967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:25.300860 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:25.311439 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e6e0df16-2dcd-4f00-97e9-82a1181fc034 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1311 microversion: 2.1 time: 0.126157 Aug 29 19:28:25.325338 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 453/905] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:25 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:25.885092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:25.885740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:25.894050 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:25.894548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:25.894984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:25.895690 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:25.896313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:25.896799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:25.913335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:25.932265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:25.932761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:25.933199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:25.933647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lazy-loading 'fault' on Instance uuid 0677d1b1-2e5a-4615-8409-7ed46c414b1f {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:28:25.994074 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7e9a2846cc4ff3b64a8551a7a733a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e73450992ac46049edabd7000d44bde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:26.014168 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a1df3a24-fa8d-4e1b-a01b-bf4fd5d75fbd tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 200 len: 1328 microversion: 2.1 time: 0.133347 Aug 29 19:28:26.015236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 453/906] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:25 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 1328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:26.336175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:26.336955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:26.343088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:26.344109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:26.344620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:26.345081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:26.345975 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:26.346557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:26.347007 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:26.539230 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:26.547241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bf4f76c0-1fe5-41d7-b805-356b59062c20 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.215831 Aug 29 19:28:26.548135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 454/907] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:26 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:26.817595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-34d175ba-33c4-41ba-afd5-fcab81c4dc2a req-47d13f53-e2cd-442d-a48c-fd561926d324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e452a2db-01eb-42e3-8d8a-cc88d0cea0e1", "tag": "01928933-0b78-4a46-b9ef-93a98cc14185"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:26.830642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-34d175ba-33c4-41ba-afd5-fcab81c4dc2a req-47d13f53-e2cd-442d-a48c-fd561926d324 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:26.831557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-34d175ba-33c4-41ba-afd5-fcab81c4dc2a req-47d13f53-e2cd-442d-a48c-fd561926d324 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:26.832040 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-34d175ba-33c4-41ba-afd5-fcab81c4dc2a req-47d13f53-e2cd-442d-a48c-fd561926d324 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:26.854473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-34d175ba-33c4-41ba-afd5-fcab81c4dc2a req-47d13f53-e2cd-442d-a48c-fd561926d324 service nova] Creating event network-changed:01928933-0b78-4a46-b9ef-93a98cc14185 for instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 on hv-cinder-85501 Aug 29 19:28:26.861401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-34d175ba-33c4-41ba-afd5-fcab81c4dc2a req-47d13f53-e2cd-442d-a48c-fd561926d324 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049185 Aug 29 19:28:26.862548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 454/908] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:27.039141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:27.039742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:27.046711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:27.047206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:27.047630 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:27.048460 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:27.048897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:27.049318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:27.063543 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] HTTP exception thrown: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Request method failure captured: Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f HTTP/1.1 Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHp-hNadg193W4Qntvg3QO535FwWTijK7gGPOe9EqDrvE0IQcGeaVTM8QnIUvQVA-lwtPgGWJ3GNLjwSbJNpg1-Hc999IM9qcV6Ibj03yiebKr4L1bd0JhshQCNd2-FDXC3O7kIiXHhH7ToDiUEtFRWERltbHR9_VBd1TamSp_7kOQ Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:27.065882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e73450992ac46049edabd7000d44bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e73450992ac46049edabd7000d44bde"}]}] Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9d7e9a2846cc4ff3b64a8551a7a733a2 Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:27.067245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '0677d1b1-2e5a-4615-8409-7ed46c414b1f'} Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:27.068118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:27.069380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:27.070567 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Returning 404 to user: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:27.070567 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a173e5df-9973-4004-89c7-b5f66c7229b5 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 404 len: 111 microversion: 2.1 time: 0.032127 Aug 29 19:28:27.071895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 455/909] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:27 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:27.078002 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-8d8e197d-6fed-416f-a0d3-af2c5962d37d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '.version_select at 0x7f1fde26ba60>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:27.159702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-8d8e197d-6fed-416f-a0d3-af2c5962d37d tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666298163" status: 202 len: 0 microversion: 2.1 time: 0.086617 Aug 29 19:28:27.163743 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 455/910] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 19:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666298163 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:28:27.568594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:27.569199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:27.577210 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:27.583650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:27.583650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:27.583650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:27.583650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:27.584085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:27.878838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:27.887483 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-10e5ae78-2f26-4d92-a192-dd9bef984ff1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.322659 Aug 29 19:28:27.888432 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 456/911] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:27 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:28.909613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:28.910340 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:28.919172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:28.919657 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:28.920208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:28.920893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:28.921346 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:28.921766 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:29.065603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:29.073404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5c4dfe14-8136-4bc8-9f3c-60eb512047ec tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.168562 Aug 29 19:28:29.073955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 456/912] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:28 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:28:30.094570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:30.095695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:30.102824 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:30.103311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:30.104005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:30.104714 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:30.105172 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:30.105599 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:30.247768 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:30.255411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7d8cf57b-ec8f-46a1-9530-6d7186c61fb9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.164840 Aug 29 19:28:30.256107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 457/913] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:30 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:31.017321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:31.017929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:31.025973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:31.026635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:31.027136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:31.027865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:31.028324 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:31.028747 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:31.043746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] HTTP exception thrown: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Request method failure captured: Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f HTTP/1.1 Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRHp-hNadg193W4Qntvg3QO535FwWTijK7gGPOe9EqDrvE0IQcGeaVTM8QnIUvQVA-lwtPgGWJ3GNLjwSbJNpg1-Hc999IM9qcV6Ibj03yiebKr4L1bd0JhshQCNd2-FDXC3O7kIiXHhH7ToDiUEtFRWERltbHR9_VBd1TamSp_7kOQ Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:31.045146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e73450992ac46049edabd7000d44bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e73450992ac46049edabd7000d44bde"}]}] Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9d7e9a2846cc4ff3b64a8551a7a733a2 Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.046814 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '0677d1b1-2e5a-4615-8409-7ed46c414b1f'} Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:31.047760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.049599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.053166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Returning 404 to user: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:31.053166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6188e676-8143-4d3b-9873-726578446ae4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 404 len: 111 microversion: 2.1 time: 0.034209 Aug 29 19:28:31.053166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 457/914] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:28:31 2022] DELETE /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:31.055184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:31.055797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 0677d1b1-2e5a-4615-8409-7ed46c414b1f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:31.058624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:31.059296 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=8 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:31.062723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:31.063208 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:31.064501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:31.065219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:31.065674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:31.066164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:31.080949 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] HTTP exception thrown: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Request method failure captured: Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f HTTP/1.1 Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHp-hNadg193W4Qntvg3QO535FwWTijK7gGPOe9EqDrvE0IQcGeaVTM8QnIUvQVA-lwtPgGWJ3GNLjwSbJNpg1-Hc999IM9qcV6Ibj03yiebKr4L1bd0JhshQCNd2-FDXC3O7kIiXHhH7ToDiUEtFRWERltbHR9_VBd1TamSp_7kOQ Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:31.082475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e73450992ac46049edabd7000d44bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e73450992ac46049edabd7000d44bde"}]}] Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9d7e9a2846cc4ff3b64a8551a7a733a2 Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.084150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '0677d1b1-2e5a-4615-8409-7ed46c414b1f'} Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:31.085078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. Aug 29 19:28:31.086612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:31.088687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Returning 404 to user: Instance 0677d1b1-2e5a-4615-8409-7ed46c414b1f could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:31.088687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c577d2ba-098c-4645-aebf-59b80a97e414 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f" status: 404 len: 111 microversion: 2.1 time: 0.032526 Aug 29 19:28:31.088687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 458/915] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:31 2022] GET /compute/v2.1/servers/0677d1b1-2e5a-4615-8409-7ed46c414b1f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:31.276888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:31.278085 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:31.284377 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:31.284873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:31.285367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:31.286174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:31.286638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:31.287070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:31.436413 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:31.444885 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ab0656a4-4ff6-4420-aace-05b9360cd11f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.171896 Aug 29 19:28:31.445452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 458/916] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:31 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:32.426655 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:32.446641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:32.446641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:32.446641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:32.446641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:32.447325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:32.447325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:32.447325 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:32.451080 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] HTTP exception thrown: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Request method failure captured: Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a HTTP/1.1 Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRHp-hNadg193W4Qntvg3QO535FwWTijK7gGPOe9EqDrvE0IQcGeaVTM8QnIUvQVA-lwtPgGWJ3GNLjwSbJNpg1-Hc999IM9qcV6Ibj03yiebKr4L1bd0JhshQCNd2-FDXC3O7kIiXHhH7ToDiUEtFRWERltbHR9_VBd1TamSp_7kOQ Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:32.452667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e73450992ac46049edabd7000d44bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e73450992ac46049edabd7000d44bde"}]}] Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9d7e9a2846cc4ff3b64a8551a7a733a2 Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.454836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '63d4166d-63f1-49f0-a7ce-487fb9ce176a'} Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:32.455644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.457221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.458554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Returning 404 to user: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:32.458554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7dab2f73-0edf-405b-853c-537f21af7715 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 404 len: 111 microversion: 2.1 time: 0.031899 Aug 29 19:28:32.458554 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 459/917] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:28:32 2022] DELETE /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:32.463788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:32.464439 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] [instance: 63d4166d-63f1-49f0-a7ce-487fb9ce176a] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:32.466394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:32.469288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:32.469925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:32.471726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:32.472250 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:32.472680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:32.473377 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:32.473824 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:32.474244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:32.476969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:32.477569 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:32.479220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:32.479220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:32.479442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:32.480075 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:32.488784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] HTTP exception thrown: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Request method failure captured: Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a HTTP/1.1 Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRHp-hNadg193W4Qntvg3QO535FwWTijK7gGPOe9EqDrvE0IQcGeaVTM8QnIUvQVA-lwtPgGWJ3GNLjwSbJNpg1-Hc999IM9qcV6Ibj03yiebKr4L1bd0JhshQCNd2-FDXC3O7kIiXHhH7ToDiUEtFRWERltbHR9_VBd1TamSp_7kOQ Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:32.490322 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/8e73450992ac46049edabd7000d44bde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/8e73450992ac46049edabd7000d44bde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_8e73450992ac46049edabd7000d44bde"}]}] Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 8e73450992ac46049edabd7000d44bde Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2123718905 Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9d7e9a2846cc4ff3b64a8551a7a733a2 Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeTestJSON-2123718905-project Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.491940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '63d4166d-63f1-49f0-a7ce-487fb9ce176a'} Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:32.496542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. Aug 29 19:28:32.498626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:32.500067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] Returning 404 to user: Instance 63d4166d-63f1-49f0-a7ce-487fb9ce176a could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:32.500067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e440e6b7-7a69-4c69-b5e6-32b267bf4fa4 tempest-AttachVolumeTestJSON-2123718905 tempest-AttachVolumeTestJSON-2123718905-project] 10.222.0.62 "GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a" status: 404 len: 111 microversion: 2.1 time: 0.031763 Aug 29 19:28:32.500067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 459/918] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:32 2022] GET /compute/v2.1/servers/63d4166d-63f1-49f0-a7ce-487fb9ce176a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:32.625649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:32.634293 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7239cdb0-8796-4ebc-a0af-66538d48f797 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.168771 Aug 29 19:28:32.635103 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 460/919] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:32 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:32.995696 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-525a8186-3d61-461b-8ea7-d66d8244b25d req-61c8a761-45a1-488f-8d09-220f0d249bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e452a2db-01eb-42e3-8d8a-cc88d0cea0e1", "name": "network-vif-plugged", "status": "completed", "tag": "01928933-0b78-4a46-b9ef-93a98cc14185"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:33.007847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-525a8186-3d61-461b-8ea7-d66d8244b25d req-61c8a761-45a1-488f-8d09-220f0d249bb3 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:33.008632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-525a8186-3d61-461b-8ea7-d66d8244b25d req-61c8a761-45a1-488f-8d09-220f0d249bb3 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:33.009065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-525a8186-3d61-461b-8ea7-d66d8244b25d req-61c8a761-45a1-488f-8d09-220f0d249bb3 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:33.020576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-525a8186-3d61-461b-8ea7-d66d8244b25d req-61c8a761-45a1-488f-8d09-220f0d249bb3 service nova] Creating event network-vif-plugged:01928933-0b78-4a46-b9ef-93a98cc14185 for instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 on hv-cinder-85501 Aug 29 19:28:33.026022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-525a8186-3d61-461b-8ea7-d66d8244b25d req-61c8a761-45a1-488f-8d09-220f0d249bb3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040367 Aug 29 19:28:33.026627 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 460/920] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:33.656788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:33.658123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:33.665020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:33.667706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:33.668214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:33.669260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:33.669848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:33.670287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:33.948299 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:33.955913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2da34d14-3211-4fdb-b838-9ceb5b970e3c tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.303353 Aug 29 19:28:33.956479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 461/921] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:33 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:34.988418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:34.990286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:35.014287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:35.014662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:35.019806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:35.021110 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:35.021763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:35.022201 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:35.227336 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:35.245905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0d498361-06e1-4b9f-bfa6-685e9bd3c61b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1367 microversion: 2.1 time: 0.272571 Aug 29 19:28:35.246497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 461/922] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:34 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:36.267820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:36.268563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:36.277500 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:36.278262 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:36.278727 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:36.279452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:36.280156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:36.280594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:36.456912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:28:36.465935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a637e280-1ae8-42e2-bede-b17850b4d0fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1557 microversion: 2.1 time: 0.202361 Aug 29 19:28:36.476788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 462/923] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:28:36 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:28:36.501734 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:36.502381 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:28:36.509416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:36.509905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:36.510335 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:36.511038 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:36.511681 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:36.512139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:36.609156 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ec83a5c2-ecf2-4225-ac23-082147e5a04e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107871 Aug 29 19:28:36.609156 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 462/924] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:28:36 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:37.881663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-8e782868-4597-4c46-a901-916a8a0dce4c req-5fe51356-61c8-4cf2-9e45-4f3f7c14eaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e452a2db-01eb-42e3-8d8a-cc88d0cea0e1", "tag": "01928933-0b78-4a46-b9ef-93a98cc14185"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:37.888287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8e782868-4597-4c46-a901-916a8a0dce4c req-5fe51356-61c8-4cf2-9e45-4f3f7c14eaf2 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:28:37.888766 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8e782868-4597-4c46-a901-916a8a0dce4c req-5fe51356-61c8-4cf2-9e45-4f3f7c14eaf2 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:28:37.889186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8e782868-4597-4c46-a901-916a8a0dce4c req-5fe51356-61c8-4cf2-9e45-4f3f7c14eaf2 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:28:37.900819 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-8e782868-4597-4c46-a901-916a8a0dce4c req-5fe51356-61c8-4cf2-9e45-4f3f7c14eaf2 service nova] Creating event network-changed:01928933-0b78-4a46-b9ef-93a98cc14185 for instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 on hv-cinder-85501 Aug 29 19:28:37.906474 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-8e782868-4597-4c46-a901-916a8a0dce4c req-5fe51356-61c8-4cf2-9e45-4f3f7c14eaf2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032259 Aug 29 19:28:37.907127 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 463/925] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:40.331629 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-82449214-e3e1-4f08-a724-bb1e07c24e6f tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Action: 'create', calling method: .version_select at 0x7f1fdf564dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-81451351"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:41.188938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-82449214-e3e1-4f08-a724-bb1e07c24e6f tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.114262 Aug 29 19:28:41.188938 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 463/926] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Aug 29 19:28:40 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1116 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 19:28:41.201661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b999a12c-7a91-40e1-85ac-8455fb38a668 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde47be50>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:41.259495 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b999a12c-7a91-40e1-85ac-8455fb38a668 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 200 len: 343 microversion: 2.1 time: 0.062623 Aug 29 19:28:41.263632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 464/927] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:28:41 2022] GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 343 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:28:42.273605 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9a2f8384-0d0b-412f-9eba-6ef204b9e9fc tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde2d0700>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:42.324545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9a2f8384-0d0b-412f-9eba-6ef204b9e9fc tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 200 len: 344 microversion: 2.1 time: 0.055345 Aug 29 19:28:42.325116 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 464/928] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:28:42 2022] GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:42.339139 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b45f95a9-b55f-4efb-84f8-8df8b576b01d tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Action: 'create', calling method: .version_select at 0x7f1fde46c820>, body: {"snapshot": {"volume_id": "9111545d-36d5-4581-aa19-d5503d7c3a06", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-971303605"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:28:43.022395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b45f95a9-b55f-4efb-84f8-8df8b576b01d tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.688840 Aug 29 19:28:43.023096 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 465/929] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Aug 29 19:28:42 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:43.035022 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3df7ff15-2a96-4cc1-9441-f98c2077abea tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde278e50>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:43.066010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3df7ff15-2a96-4cc1-9441-f98c2077abea tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 286 microversion: 2.1 time: 0.036000 Aug 29 19:28:43.066721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 465/930] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:43 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:43.077642 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-65cff270-5489-4e35-8b0e-f228984fce75 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde4f9550>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:43.111547 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-65cff270-5489-4e35-8b0e-f228984fce75 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037717 Aug 29 19:28:43.114028 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 466/931] 10.222.0.62 () {58 vars in 1140 bytes} [Mon Aug 29 19:28:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:43.123374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-edc29366-7069-4655-b5e9-98999e22def8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde680790>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:43.153249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-edc29366-7069-4655-b5e9-98999e22def8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 286 microversion: 2.1 time: 0.033459 Aug 29 19:28:43.153813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 466/932] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:43 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:44.166534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-68c08cef-6ab5-4279-9993-0989c5486e8c tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fe1d62f70>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:44.197495 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-68c08cef-6ab5-4279-9993-0989c5486e8c tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 286 microversion: 2.1 time: 0.035265 Aug 29 19:28:44.198058 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 467/933] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:44 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:45.210389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d0ace212-b029-4d26-8f7a-26ad1982e62a tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde2cc790>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:45.242437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d0ace212-b029-4d26-8f7a-26ad1982e62a tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 286 microversion: 2.1 time: 0.036220 Aug 29 19:28:45.242939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 467/934] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:45 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:46.256001 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9983c6b0-e2e7-493e-938a-c15b1545e24c tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde579550>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:46.286194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9983c6b0-e2e7-493e-938a-c15b1545e24c tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 286 microversion: 2.1 time: 0.034939 Aug 29 19:28:46.286762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 468/935] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:46 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:47.296270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:47.297030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=35 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:47.302669 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-168744b0-2b76-4f04-8451-64a1b1dd565a tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde37d700>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:47.332570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-168744b0-2b76-4f04-8451-64a1b1dd565a tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 287 microversion: 2.1 time: 0.037751 Aug 29 19:28:47.333152 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 468/936] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:47 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:47.345789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0719ecd5-3097-4fd5-b0c5-2418134bb5b9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde47bee0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:47.532991 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0719ecd5-3097-4fd5-b0c5-2418134bb5b9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 202 len: 0 microversion: 2.1 time: 0.190878 Aug 29 19:28:47.534106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 469/937] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 19:28:47 2022] DELETE /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:28:47.544510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f2c37c22-2f66-4054-bdb2-d41ad941e8e6 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde2789d0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:47.579519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f2c37c22-2f66-4054-bdb2-d41ad941e8e6 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 200 len: 286 microversion: 2.1 time: 0.040253 Aug 29 19:28:47.580119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 469/938] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:47 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:48.589292 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=19 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:48.590071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=62 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:48.594350 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-10911863-76de-4e9f-b9e1-35c9e66df6a9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde4f9dc0>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:48.621991 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-10911863-76de-4e9f-b9e1-35c9e66df6a9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] HTTP exception thrown: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-10911863-76de-4e9f-b9e1-35c9e66df6a9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Request method failure captured: Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 HTTP/1.1 Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRNodNAmwsOCIm07TbVILUBvO7RI9Fidkd0s-yWA8DTO76Q3IKcjdDAp6iKvsVgKQRWCcOEnaY7TktUfWXzCnc5rCxs9t94xHv61hkMmZ8mSMT5zVn4USKMNcCSFk11Dv0uFKh1quZIAxKmmLklqxKA-Qwjq_JgpLc_lb_FA6AuubYo Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:48.625953 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9757c1b18f9d41b4bc6a88cae734cb8e"}]}] Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: f8a9c50fa8e045689decb316fe9244e0 Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'd937cca5-8da6-492f-b148-1fbde72073b3'} Aug 29 19:28:48.627988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. (HTTP 404) (Request-ID: req-4f7766a4-898e-4b65-8e1b-f98ba32391d5) Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.629032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:28:48.630752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 19:28:48.632476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-10911863-76de-4e9f-b9e1-35c9e66df6a9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Returning 404 to user: Snapshot d937cca5-8da6-492f-b148-1fbde72073b3 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:48.634507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-10911863-76de-4e9f-b9e1-35c9e66df6a9 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3" status: 404 len: 111 microversion: 2.1 time: 0.038959 Aug 29 19:28:48.636397 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 470/939] 10.222.0.62 () {58 vars in 1251 bytes} [Mon Aug 29 19:28:48 2022] GET /compute/v2.1/os-snapshots/d937cca5-8da6-492f-b148-1fbde72073b3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:48.637071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-33f48837-2006-4079-bc07-290ce4df698e tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde2d0790>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:48.924092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-33f48837-2006-4079-bc07-290ce4df698e tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 202 len: 0 microversion: 2.1 time: 0.291370 Aug 29 19:28:48.924660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 470/940] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:28:48 2022] DELETE /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:28:48.933142 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e4dd6dcd-1d1c-4cb1-8dde-8fff93893dde tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde47ba60>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:48.983488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e4dd6dcd-1d1c-4cb1-8dde-8fff93893dde tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 200 len: 343 microversion: 2.1 time: 0.054415 Aug 29 19:28:48.984133 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 471/941] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:28:48 2022] GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:28:50.000598 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-85314709-4d1c-46ec-b761-48552a3b67ec tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde2cc040>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:50.032198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-85314709-4d1c-46ec-b761-48552a3b67ec tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] HTTP exception thrown: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-85314709-4d1c-46ec-b761-48552a3b67ec tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Request method failure captured: Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 HTTP/1.1 Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRNodNAmwsOCIm07TbVILUBvO7RI9Fidkd0s-yWA8DTO76Q3IKcjdDAp6iKvsVgKQRWCcOEnaY7TktUfWXzCnc5rCxs9t94xHv61hkMmZ8mSMT5zVn4USKMNcCSFk11Dv0uFKh1quZIAxKmmLklqxKA-Qwjq_JgpLc_lb_FA6AuubYo Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:50.034455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9757c1b18f9d41b4bc6a88cae734cb8e"}]}] Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: f8a9c50fa8e045689decb316fe9244e0 Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '9111545d-36d5-4581-aa19-d5503d7c3a06'} Aug 29 19:28:50.038314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. (HTTP 404) (Request-ID: req-91246fd0-925d-4cc2-85f7-3d6af7a9227c) Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.039166 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:28:50.040355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:28:50.041508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-85314709-4d1c-46ec-b761-48552a3b67ec tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Returning 404 to user: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-85314709-4d1c-46ec-b761-48552a3b67ec tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 404 len: 109 microversion: 2.1 time: 0.041435 Aug 29 19:28:50.042641 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 471/942] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:28:49 2022] GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:50.050487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f04eaba5-2303-4028-b66c-c218eeddfba8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fe1d87820>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:50.080697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-f04eaba5-2303-4028-b66c-c218eeddfba8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] HTTP exception thrown: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f04eaba5-2303-4028-b66c-c218eeddfba8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Request method failure captured: Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: DELETE /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 HTTP/1.1 Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRNodNAmwsOCIm07TbVILUBvO7RI9Fidkd0s-yWA8DTO76Q3IKcjdDAp6iKvsVgKQRWCcOEnaY7TktUfWXzCnc5rCxs9t94xHv61hkMmZ8mSMT5zVn4USKMNcCSFk11Dv0uFKh1quZIAxKmmLklqxKA-Qwjq_JgpLc_lb_FA6AuubYo Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:28:50.082954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9757c1b18f9d41b4bc6a88cae734cb8e"}]}] Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: f8a9c50fa8e045689decb316fe9244e0 Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '9111545d-36d5-4581-aa19-d5503d7c3a06'} Aug 29 19:28:50.084477 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. (HTTP 404) (Request-ID: req-94c4895f-37d0-41e0-bd73-adc99db46ff6) Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.085303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:28:50.086892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:28:50.092691 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f04eaba5-2303-4028-b66c-c218eeddfba8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Returning 404 to user: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f04eaba5-2303-4028-b66c-c218eeddfba8 tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 404 len: 109 microversion: 2.1 time: 0.038298 Aug 29 19:28:50.094396 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 472/943] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:28:50 2022] DELETE /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:50.099186 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-650fd778-288c-4a04-a7cd-4284a82a14bb tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Calling method '.version_select at 0x7f1fde2720d0>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:28:50.128983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-650fd778-288c-4a04-a7cd-4284a82a14bb tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] HTTP exception thrown: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-650fd778-288c-4a04-a7cd-4284a82a14bb tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Request method failure captured: Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 HTTP/1.1 Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRNodNAmwsOCIm07TbVILUBvO7RI9Fidkd0s-yWA8DTO76Q3IKcjdDAp6iKvsVgKQRWCcOEnaY7TktUfWXzCnc5rCxs9t94xHv61hkMmZ8mSMT5zVn4USKMNcCSFk11Dv0uFKh1quZIAxKmmLklqxKA-Qwjq_JgpLc_lb_FA6AuubYo Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:28:50.130922 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9757c1b18f9d41b4bc6a88cae734cb8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9757c1b18f9d41b4bc6a88cae734cb8e"}]}] Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 9757c1b18f9d41b4bc6a88cae734cb8e Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113197132 Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: f8a9c50fa8e045689decb316fe9244e0 Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113197132-project Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '9111545d-36d5-4581-aa19-d5503d7c3a06'} Aug 29 19:28:50.132622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. (HTTP 404) (Request-ID: req-9915173d-87f9-46b2-90df-1f6dbe5a85f1) Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.133783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:28:50.135315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:28:50.142069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-650fd778-288c-4a04-a7cd-4284a82a14bb tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] Returning 404 to user: Volume 9111545d-36d5-4581-aa19-d5503d7c3a06 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-650fd778-288c-4a04-a7cd-4284a82a14bb tempest-VolumesSnapshotsTestJSON-2113197132 tempest-VolumesSnapshotsTestJSON-2113197132-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06" status: 404 len: 109 microversion: 2.1 time: 0.036933 Aug 29 19:28:50.144825 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 472/944] 10.222.0.62 () {58 vars in 1245 bytes} [Mon Aug 29 19:28:50 2022] GET /compute/v2.1/os-volumes/9111545d-36d5-4581-aa19-d5503d7c3a06 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:29:03.212859 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:03.213486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:03.215399 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-ebea7e13-a322-4480-af46-acb68eff5583 req-20fc9d82-2fb2-4b69-8ba0-76842473494a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:03.221440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:03.221930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:03.224386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:03.224386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:03.224386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:03.224386 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:03.226716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-ebea7e13-a322-4480-af46-acb68eff5583 req-20fc9d82-2fb2-4b69-8ba0-76842473494a service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:03.227273 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-ebea7e13-a322-4480-af46-acb68eff5583 req-20fc9d82-2fb2-4b69-8ba0-76842473494a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:03.227874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-ebea7e13-a322-4480-af46-acb68eff5583 req-20fc9d82-2fb2-4b69-8ba0-76842473494a service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:03.240783 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-ebea7e13-a322-4480-af46-acb68eff5583 req-20fc9d82-2fb2-4b69-8ba0-76842473494a service nova] Creating event network-changed:d83b4120-aa4e-498d-b627-3c7df3272a2d for instance fdf00998-1f50-44db-b548-fe6bc04f5742 on hv-cinder-85501 Aug 29 19:29:03.246816 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-ebea7e13-a322-4480-af46-acb68eff5583 req-20fc9d82-2fb2-4b69-8ba0-76842473494a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036233 Aug 29 19:29:03.247589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 473/945] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:29:03.256501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:29:03.740186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-da2790f8-23ee-4f81-b98f-62faaf8ad64c tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 204 len: 0 microversion: 2.1 time: 0.532016 Aug 29 19:29:03.740932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 473/946] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:29:03 2022] DELETE /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:29:03.757926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:03.757926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:03.767217 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:03.768570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:03.769549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:03.771127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:03.772208 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:03.773280 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:03.934188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:03.942823 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-51a525a5-37cf-4cb3-b2a7-ddcb4c556391 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.196470 Aug 29 19:29:03.943416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 474/947] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:03 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:04.967119 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:04.967826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:04.978038 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:04.978936 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:04.979777 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:04.980869 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:04.981592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:04.982282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:05.162718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:05.170629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b459d54d-9bd1-4242-9984-aaad8337423e tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1570 microversion: 2.1 time: 0.207835 Aug 29 19:29:05.171346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 474/948] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:04 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:06.193106 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:06.194158 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:06.200672 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:06.201143 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:06.201570 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:06.202266 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:06.203111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:06.203533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:06.692950 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:06.701985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-274da3ee-1265-426a-b885-770c53eb1102 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1452 microversion: 2.1 time: 0.512968 Aug 29 19:29:06.703074 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 475/949] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:06 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1452 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:07.302815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-f42556d2-1ad9-42a8-937b-1cd6ae88fc11 req-249ec007-1b8f-4852-bb0a-99fe60521f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf00998-1f50-44db-b548-fe6bc04f5742", "name": "network-vif-deleted", "tag": "d83b4120-aa4e-498d-b627-3c7df3272a2d"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:07.313739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-f42556d2-1ad9-42a8-937b-1cd6ae88fc11 req-249ec007-1b8f-4852-bb0a-99fe60521f59 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:07.314216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-f42556d2-1ad9-42a8-937b-1cd6ae88fc11 req-249ec007-1b8f-4852-bb0a-99fe60521f59 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:07.314648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-f42556d2-1ad9-42a8-937b-1cd6ae88fc11 req-249ec007-1b8f-4852-bb0a-99fe60521f59 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:07.326663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-f42556d2-1ad9-42a8-937b-1cd6ae88fc11 req-249ec007-1b8f-4852-bb0a-99fe60521f59 service nova] Creating event network-vif-deleted:d83b4120-aa4e-498d-b627-3c7df3272a2d for instance fdf00998-1f50-44db-b548-fe6bc04f5742 on hv-cinder-85501 Aug 29 19:29:07.332387 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-f42556d2-1ad9-42a8-937b-1cd6ae88fc11 req-249ec007-1b8f-4852-bb0a-99fe60521f59 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034492 Aug 29 19:29:07.333267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 475/950] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:07.723265 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:07.724652 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:07.732196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:07.732874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:07.733463 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:07.735031 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:07.735645 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:07.736270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:07.813780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:07.822612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-dd84ae3d-3035-45bb-bae1-65903d19bddd tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1220 microversion: 2.1 time: 0.102966 Aug 29 19:29:07.823622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 476/951] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:07 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:08.847509 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:08.849150 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:08.857170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:08.857874 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:08.858534 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:08.860005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:08.860624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:08.861839 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:08.897593 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:08.898117 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:08.898576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:08.899013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lazy-loading 'fault' on Instance uuid fdf00998-1f50-44db-b548-fe6bc04f5742 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:29:08.947221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a111fd5f36324d75ac8ad55e762aeaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2ee7950a334c8888dae733cb698533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:08.961498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8f220f39-60f9-4cdb-8431-8d4dcffb43ad tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 200 len: 1225 microversion: 2.1 time: 0.120881 Aug 29 19:29:08.962091 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 476/952] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:08 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:09.985530 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:09.986769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] [instance: fdf00998-1f50-44db-b548-fe6bc04f5742] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:09.995935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:09.996429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:09.996953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:09.997725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:09.998180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:09.998849 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:10.016113 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] HTTP exception thrown: Instance fdf00998-1f50-44db-b548-fe6bc04f5742 could not be found. Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Request method failure captured: Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 HTTP/1.1 Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRJAPnwF4ovi1VS5rZycv96iGlvxAKr3qLuxplcehBowwUcLcCMRI9h3nXJp4q3hI4xQRet2JBQu6sfTGHbPAouzjNppSkCkjWi9QkMocure113Nb58kHMXdeC3UXUzZoOX2nlJspAKMDsr89qjZbBwYR_r8uLvBGtHBaF32fECoAHA Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: ce2ee7950a334c8888dae733cb698533 Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-TestShelveInstance-154326722 Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:29:10.017790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ce2ee7950a334c8888dae733cb698533"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ce2ee7950a334c8888dae733cb698533"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ce2ee7950a334c8888dae733cb698533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ce2ee7950a334c8888dae733cb698533"}]}] Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-TestShelveInstance-154326722 Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: ce2ee7950a334c8888dae733cb698533 Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-TestShelveInstance-154326722 Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-TestShelveInstance-154326722-project Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: a111fd5f36324d75ac8ad55e762aeaca Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-TestShelveInstance-154326722-project Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance fdf00998-1f50-44db-b548-fe6bc04f5742 could not be found. Aug 29 19:29:10.019305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'fdf00998-1f50-44db-b548-fe6bc04f5742'} Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf00998-1f50-44db-b548-fe6bc04f5742 could not be found. Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:29:10.020210 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf00998-1f50-44db-b548-fe6bc04f5742 could not be found. Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf00998-1f50-44db-b548-fe6bc04f5742 could not be found. Aug 29 19:29:10.021514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:10.022965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Returning 404 to user: Instance fdf00998-1f50-44db-b548-fe6bc04f5742 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:29:10.022965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-79c5799d-13ee-4c49-9980-f377b008c0a5 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742" status: 404 len: 111 microversion: 2.1 time: 0.037612 Aug 29 19:29:10.022965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 477/953] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:09 2022] GET /compute/v2.1/servers/fdf00998-1f50-44db-b548-fe6bc04f5742 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:29:10.301095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-06f4ee71-9f22-4a4f-9377-233cfd3076c7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] Calling method '.version_select at 0x7f1fde579c10>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:10.408943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-06f4ee71-9f22-4a4f-9377-233cfd3076c7 tempest-TestShelveInstance-154326722 tempest-TestShelveInstance-154326722-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1637069204" status: 202 len: 0 microversion: 2.1 time: 0.113075 Aug 29 19:29:10.409609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 477/954] 10.222.0.62 () {58 vars in 1254 bytes} [Mon Aug 29 19:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1637069204 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:29:19.690912 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-56574", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "networks": [{"uuid": "a923276f-77f0-4dfb-a15d-8dd449f66658"}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:19.765749 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] validate_networks() for [('a923276f-77f0-4dfb-a15d-8dd449f66658', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:29:20.004727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=22 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:20.273046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:29:20.273468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:29:20.273969 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:29:20.274376 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:29:20.274785 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:29:20.283701 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:20.284218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:20.284674 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:20.285403 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:20.285861 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:20.286289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:20.303391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Getting quotas for project b781311ee43640d9b485cbc915560b76. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:29:20.307508 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Getting quotas for user ec34a575c6c748989e3460350d07e36f and project b781311ee43640d9b485cbc915560b76. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:29:20.319235 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:29:20.321555 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:29:20.466041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f25ec63f-6b2f-40d7-b58e-738e9baaae12 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779473 Aug 29 19:29:20.466678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 478/955] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:29:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:29:20.476693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:20.479057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:20.481251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6f8229bb-8f53-429d-b509-67ab2bff546c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:20.481804 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6f8229bb-8f53-429d-b509-67ab2bff546c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:20.554291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6f8229bb-8f53-429d-b509-67ab2bff546c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:20.554291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6f8229bb-8f53-429d-b509-67ab2bff546c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1214 microversion: 2.1 time: 0.078947 Aug 29 19:29:20.554973 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 478/956] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:20 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:21.575091 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9f2f091a-c1bf-4451-8686-e01a6b8a96ba tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:21.575731 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9f2f091a-c1bf-4451-8686-e01a6b8a96ba tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:21.629018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9f2f091a-c1bf-4451-8686-e01a6b8a96ba tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:21.636048 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9f2f091a-c1bf-4451-8686-e01a6b8a96ba tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1214 microversion: 2.1 time: 0.065405 Aug 29 19:29:21.641292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 479/957] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:21 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:21.723595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:21.724212 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:21.730036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:21.730469 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:21.730898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:21.731582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:21.732076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:21.732496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:21.755608 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-73a1521b-22cd-45c8-9801-3bf80625aeef tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/ips" status: 200 len: 150 microversion: 2.1 time: 0.038551 Aug 29 19:29:21.756206 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 479/958] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:29:21 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:21.768387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40343ba3-e878-47ee-9885-1a5ed8de7621"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:21.770815 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:21.777003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:21.777489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:21.777931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:21.778631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:21.779086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:21.779513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:21.864178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Invalid volume: volume 40343ba3-e878-47ee-9885-1a5ed8de7621 is already attached to instances: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: POST /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/os-volume_attachments HTTP/1.1 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 74 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:29:21.865889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {"volumeAttachment": {"volumeId": "40343ba3-e878-47ee-9885-1a5ed8de7621"}} Aug 29 19:29:21.873592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Invalid volume: volume 40343ba3-e878-47ee-9885-1a5ed8de7621 is already attached to instances: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'server_id': 'e452a2db-01eb-42e3-8d8a-cc88d0cea0e1', 'body': {'volumeAttachment': {'volumeId': '40343ba3-e878-47ee-9885-1a5ed8de7621'}}} Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 40343ba3-e878-47ee-9885-1a5ed8de7621 is already attached to instances: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:21.874788 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 40343ba3-e878-47ee-9885-1a5ed8de7621 is already attached to instances: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:21.876367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 40343ba3-e878-47ee-9885-1a5ed8de7621 is already attached to instances: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 400 to user: Invalid volume: volume 40343ba3-e878-47ee-9885-1a5ed8de7621 is already attached to instances: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-39d574d6-6414-40fd-b08c-61d6a16a1651 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103538 Aug 29 19:29:21.877875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 480/959] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:29:21 2022] POST /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:29:21.878525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:21.878525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:21.882710 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:21.883186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:21.883617 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:21.884346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:21.884802 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:21.885244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:21.911370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:29:22.188467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-43fe600f-6461-404e-8870-c5fda2595938 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 204 len: 0 microversion: 2.1 time: 0.315960 Aug 29 19:29:22.189050 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 480/960] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:29:21 2022] DELETE /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:29:22.197457 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:22.198070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:22.204875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:22.205343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:22.205774 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:22.206464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:22.206915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:22.207337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:22.343430 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:22.351434 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c6b5b71e-1e4b-4121-b92d-d9070ffd9eb4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1682 microversion: 2.1 time: 0.157984 Aug 29 19:29:22.352016 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 481/961] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:22 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:22.660638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:22.661254 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:22.668188 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:22.668667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:22.669104 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:22.669796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:22.670248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:22.671312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:22.735511 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:22.743694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c2818b9d-2731-4ac4-812b-6271a8f9561f tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1266 microversion: 2.1 time: 0.087307 Aug 29 19:29:22.745529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 481/962] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:22 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:23.373712 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:23.374358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:23.381111 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:23.381596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:23.382216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:23.382737 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:23.383193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:23.383613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:23.518095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:23.526075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d918dca9-721b-40d4-8db7-449c4b1e3195 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1682 microversion: 2.1 time: 0.156304 Aug 29 19:29:23.526633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 482/963] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:23 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:29:23.764452 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:23.765164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:23.771800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:23.772317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:23.772803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:23.773496 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:23.773949 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:23.774373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:23.837585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:23.845877 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-adf4f525-020b-4e88-9ea6-a389905960c4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1266 microversion: 2.1 time: 0.085557 Aug 29 19:29:23.846433 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 482/964] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:23 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:24.548366 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:24.549109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:24.555494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:24.556018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:24.556458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:24.557162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:24.557614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:24.558032 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:24.871382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:24.873345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:24.885124 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:24.886405 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:24.887416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:24.888923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:24.891807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:24.892344 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:25.057846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:25.077796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a5629e28-fffd-49eb-a905-f5e818bd19a6 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1274 microversion: 2.1 time: 0.202493 Aug 29 19:29:25.077796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 483/965] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:24 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:25.141750 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:25.157378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4f2e9da9-2913-444e-9746-216f8e55a4b9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1682 microversion: 2.1 time: 0.606024 Aug 29 19:29:25.157378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 483/966] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:24 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1682 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:25.682529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-818a003c-a0ff-430f-a6b2-74660cf2a748 req-9eaf5788-bdcb-4f73-ba02-3b97f63b3449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e452a2db-01eb-42e3-8d8a-cc88d0cea0e1", "name": "network-vif-deleted", "tag": "01928933-0b78-4a46-b9ef-93a98cc14185"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:25.694747 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-818a003c-a0ff-430f-a6b2-74660cf2a748 req-9eaf5788-bdcb-4f73-ba02-3b97f63b3449 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:25.695235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-818a003c-a0ff-430f-a6b2-74660cf2a748 req-9eaf5788-bdcb-4f73-ba02-3b97f63b3449 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:25.695674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-818a003c-a0ff-430f-a6b2-74660cf2a748 req-9eaf5788-bdcb-4f73-ba02-3b97f63b3449 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:25.742414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-818a003c-a0ff-430f-a6b2-74660cf2a748 req-9eaf5788-bdcb-4f73-ba02-3b97f63b3449 service nova] Creating event network-vif-deleted:01928933-0b78-4a46-b9ef-93a98cc14185 for instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 on hv-cinder-85501 Aug 29 19:29:25.757810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-818a003c-a0ff-430f-a6b2-74660cf2a748 req-9eaf5788-bdcb-4f73-ba02-3b97f63b3449 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078295 Aug 29 19:29:25.757810 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 484/967] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:26.089469 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:26.090283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:26.098650 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:26.104927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:26.105484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:26.108257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:26.108851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:26.109387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:26.173071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:26.173758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:26.182623 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:26.183349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:26.184032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:26.184913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:26.185524 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:26.186139 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:26.221922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:26.222606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:26.223389 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:26.224040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'fault' on Instance uuid e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:29:26.281277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:26.289448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d48a150d-3869-47bb-b82a-e150267e177f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 200 len: 1331 microversion: 2.1 time: 0.121174 Aug 29 19:29:26.304237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 485/968] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:26 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:29:26.312841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:26.321903 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c4bd4aaf-eb2d-407d-96de-4f0e294e87f1 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.236537 Aug 29 19:29:26.336801 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 484/969] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:26 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:26.821908 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-38722169-0f94-416d-99ac-4b0cd872cff9 req-a38f1680-1f0b-4276-836a-46ecb97eb110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e939ce-3fa7-462f-98e0-d3294571f23f", "tag": "0a057393-9fa5-416e-b81b-8f9ca4ee4f03"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:26.844812 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-38722169-0f94-416d-99ac-4b0cd872cff9 req-a38f1680-1f0b-4276-836a-46ecb97eb110 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:26.845448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-38722169-0f94-416d-99ac-4b0cd872cff9 req-a38f1680-1f0b-4276-836a-46ecb97eb110 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:26.846000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-38722169-0f94-416d-99ac-4b0cd872cff9 req-a38f1680-1f0b-4276-836a-46ecb97eb110 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:26.869503 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-38722169-0f94-416d-99ac-4b0cd872cff9 req-a38f1680-1f0b-4276-836a-46ecb97eb110 service nova] Creating event network-changed:0a057393-9fa5-416e-b81b-8f9ca4ee4f03 for instance 29e939ce-3fa7-462f-98e0-d3294571f23f on hv-cinder-85501 Aug 29 19:29:26.876856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-38722169-0f94-416d-99ac-4b0cd872cff9 req-a38f1680-1f0b-4276-836a-46ecb97eb110 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059810 Aug 29 19:29:26.878025 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 486/970] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:29:27.310596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:27.311213 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:27.317882 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:27.318599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:27.319040 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:27.319746 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:27.320355 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:27.320782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:27.334256 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 HTTP/1.1 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:29:27.335981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:29:27.337567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'e452a2db-01eb-42e3-8d8a-cc88d0cea0e1'} Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:29:27.338473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:29:27.340011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:29:27.341632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:29:27.341632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1b7e88d2-d902-4a11-aaa7-fb9493b95527 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 404 len: 111 microversion: 2.1 time: 0.030619 Aug 29 19:29:27.341632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 485/971] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:27 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:29:27.348012 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:27.349923 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:27.350062 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0f70afca-d501-4f1e-b819-06b2d6f1bd33 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '.version_select at 0x7f1fde5c9310>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:27.354866 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:27.355441 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:27.355987 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:27.356769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:27.357325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:27.357800 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:27.459783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0f70afca-d501-4f1e-b819-06b2d6f1bd33 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363864953" status: 202 len: 0 microversion: 2.1 time: 0.115292 Aug 29 19:29:27.460663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 487/972] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 19:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363864953 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:29:27.542374 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:27.551320 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-909f6eee-430e-4798-a077-5d3e5faab989 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.206948 Aug 29 19:29:27.564300 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 486/973] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:27 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:28.470610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:28.471256 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:28.478404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:28.478888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:28.479323 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:28.480059 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:28.480539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:28.480963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:28.568676 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'services' on Instance uuid 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:29:28.571764 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:28.572949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:28.580188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:28.580677 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:28.581230 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:28.581928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:28.582601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:28.583020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:28.726179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:28.734741 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0d56e09c-46f3-484d-89f0-f538f612c2a5 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.166915 Aug 29 19:29:28.735295 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 487/974] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:28 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:28.909231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bffe6902-6828-4161-9eef-9aa1b59f5b5f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments/40343ba3-e878-47ee-9885-1a5ed8de7621" status: 202 len: 0 microversion: 2.1 time: 0.442834 Aug 29 19:29:28.909836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 488/975] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:29:28 2022] DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments/40343ba3-e878-47ee-9885-1a5ed8de7621 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:29:28.924622 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:28.926937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:28.932911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:28.933395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:28.933832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:28.934533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:28.934979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:28.935401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:28.966573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-883b0544-553e-4ac9-a9c3-c30c1216708b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Aug 29 19:29:28.967155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 488/976] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:29:28 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:29.757037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:29.757782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:29.764002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:29.764615 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:29.765827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:29.766226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:29.766668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:29.767085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:29.908410 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:29.916729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1dfdc5d4-844f-4e00-8194-2e275f81db8d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.164366 Aug 29 19:29:29.917313 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 489/977] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:29 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:29.978792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:29.980957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:29.988096 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:29.988847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:29.989283 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:29.989984 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:29.990437 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:29.990863 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:30.021231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d1373e40-9f2d-487b-8dd5-a0ae8574f013 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Aug 29 19:29:30.021785 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 489/978] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:29:29 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:30.938449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:30.939047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:30.941596 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:30.946843 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:30.947237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:30.956674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:30.956674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:30.956674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:30.956674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.033540 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:31.035673 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:31.037755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:31.042958 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:31.043475 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:31.043929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.044683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:31.045315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:31.046653 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.076496 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-82a6056e-6dc6-46a4-a055-a18f33f542a7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047540 Aug 29 19:29:31.077071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 490/979] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:29:31 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:29:31.080788 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:31.088486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-abe0f20c-fa3e-4cf1-9315-bad9510ab8e8 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.153937 Aug 29 19:29:31.089173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 490/980] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:30 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:31.146071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:31.146571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:31.153611 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:31.154089 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:31.154525 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.155777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:31.156272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:31.156682 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.182633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:29:31.481233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-75819dc5-a772-4100-a0f4-ff9912d6c503 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 204 len: 0 microversion: 2.1 time: 0.338644 Aug 29 19:29:31.481761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 491/981] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:29:31 2022] DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:29:31.490228 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:31.490868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:31.496818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:31.497294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:31.497718 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.498446 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:31.498840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:31.499252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:31.628882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:31.636764 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5e5c36a2-2504-438f-ab38-b0653fa90feb tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1683 microversion: 2.1 time: 0.150725 Aug 29 19:29:31.637322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 491/982] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:31 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:32.111846 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:32.112563 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:32.114730 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=8 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:32.120017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:32.120499 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:32.120930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:32.121616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:32.122060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:32.122479 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:32.257841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:32.265651 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d17fae5e-8a0a-49db-bbd4-e1d48d00c453 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.158606 Aug 29 19:29:32.266784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 492/983] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:32 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:32.659743 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:32.660303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:32.666723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:32.667203 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:32.667639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:32.668359 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:32.668820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:32.669243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:32.796963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:32.804647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-af200b8d-a64c-4e9c-a5c0-5c672f16ddb5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1683 microversion: 2.1 time: 0.148875 Aug 29 19:29:32.805202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 492/984] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:32 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:33.287008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:33.287615 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:33.290132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:33.295027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:33.296164 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:33.296626 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:33.297321 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:33.297782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:33.298207 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:33.378650 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-9f380f43-bb18-454c-b851-171a8998f7e2 req-c506fb6e-1657-4812-9098-4373e30ee102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e939ce-3fa7-462f-98e0-d3294571f23f", "name": "network-vif-plugged", "status": "completed", "tag": "0a057393-9fa5-416e-b81b-8f9ca4ee4f03"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:33.389537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9f380f43-bb18-454c-b851-171a8998f7e2 req-c506fb6e-1657-4812-9098-4373e30ee102 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:33.389537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9f380f43-bb18-454c-b851-171a8998f7e2 req-c506fb6e-1657-4812-9098-4373e30ee102 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:33.390566 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-9f380f43-bb18-454c-b851-171a8998f7e2 req-c506fb6e-1657-4812-9098-4373e30ee102 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:33.402311 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-9f380f43-bb18-454c-b851-171a8998f7e2 req-c506fb6e-1657-4812-9098-4373e30ee102 service nova] Creating event network-vif-plugged:0a057393-9fa5-416e-b81b-8f9ca4ee4f03 for instance 29e939ce-3fa7-462f-98e0-d3294571f23f on hv-cinder-85501 Aug 29 19:29:33.408181 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-9f380f43-bb18-454c-b851-171a8998f7e2 req-c506fb6e-1657-4812-9098-4373e30ee102 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034022 Aug 29 19:29:33.408783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 493/985] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:29:33.439139 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:33.443892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-72356999-61cf-431e-aca9-032dbd2ef9c0 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.160818 Aug 29 19:29:33.444447 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 493/986] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:33 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:33.826426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:33.827644 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:33.834979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:33.835480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:33.835952 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:33.836654 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:33.837107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:33.837535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:34.028603 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:34.037479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3f2845f1-4c76-401b-b9eb-3e37e036b325 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1683 microversion: 2.1 time: 0.215267 Aug 29 19:29:34.038656 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 494/987] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:33 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:34.435572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-d6c1d15f-b59a-437e-9844-5e8969c00572 req-5137c6c1-4214-4987-8054-18332645693c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b272a17-8d0c-46ec-a9c7-3399b2785ce7", "name": "network-vif-deleted", "tag": "da59f026-4ad6-4294-8560-85ff077f3af8"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:34.446035 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d6c1d15f-b59a-437e-9844-5e8969c00572 req-5137c6c1-4214-4987-8054-18332645693c service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:34.446502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d6c1d15f-b59a-437e-9844-5e8969c00572 req-5137c6c1-4214-4987-8054-18332645693c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:34.446921 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-d6c1d15f-b59a-437e-9844-5e8969c00572 req-5137c6c1-4214-4987-8054-18332645693c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:34.459564 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-d6c1d15f-b59a-437e-9844-5e8969c00572 req-5137c6c1-4214-4987-8054-18332645693c service nova] Creating event network-vif-deleted:da59f026-4ad6-4294-8560-85ff077f3af8 for instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 on hv-cinder-85501 Aug 29 19:29:34.464444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-d6c1d15f-b59a-437e-9844-5e8969c00572 req-5137c6c1-4214-4987-8054-18332645693c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 Aug 29 19:29:34.464914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:34.465631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:34.468752 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 494/988] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:34.472497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:34.472989 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:34.473423 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:34.474123 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:34.474581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:34.475033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:34.621717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:34.633440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-95ac96f5-f704-4b3c-bdd0-302bb37d7e31 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1314 microversion: 2.1 time: 0.172913 Aug 29 19:29:34.633964 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 495/989] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:34 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:35.059944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:35.060751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:35.067230 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:35.067722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:35.068397 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:35.069203 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:35.069665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:35.070095 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:35.143141 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:35.146718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:35.151733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-f74eec09-0881-44f0-ac8f-a7a7e55720cf tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1327 microversion: 2.1 time: 0.096045 Aug 29 19:29:35.152350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 495/990] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:35 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:35.655379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:35.656054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:35.662641 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:35.663124 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:35.663558 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:35.664323 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:35.664725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:35.665154 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:35.669271 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:35.810073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:35.817988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-152a2841-c1bb-4895-9da0-9fc466dd3e20 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1502 microversion: 2.1 time: 0.167099 Aug 29 19:29:35.818539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 496/991] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:35 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:36.172982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:36.173589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:36.180716 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:36.181144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:36.181596 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:36.182315 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:36.182772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:36.183197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:36.215327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:36.215812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:36.216301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:36.216744 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'fault' on Instance uuid 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:29:36.258165 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:36.266450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-50d43eb3-d5ff-4043-b63b-b915bf5a59e4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 200 len: 1332 microversion: 2.1 time: 0.097655 Aug 29 19:29:36.267011 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 496/992] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:36 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:37.292843 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:37.293453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:37.301247 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:37.301728 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:37.302161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:37.302850 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:37.303304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:37.303723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:37.317739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 HTTP/1.1 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:29:37.319367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:29:37.321055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '8b272a17-8d0c-46ec-a9c7-3399b2785ce7'} Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:29:37.321984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:29:37.323597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:29:37.324970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:29:37.324970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-91cca2c6-3318-47ab-9f43-5c5a34e63c5a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 404 len: 111 microversion: 2.1 time: 0.031708 Aug 29 19:29:37.324970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 497/993] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:37 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:29:37.330303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0cb12efc-463f-4fb9-9c4b-50c59faf3a32 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '.version_select at 0x7f1fde278310>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:37.395313 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0cb12efc-463f-4fb9-9c4b-50c59faf3a32 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279232467" status: 202 len: 0 microversion: 2.1 time: 0.069274 Aug 29 19:29:37.395935 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 497/994] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 19:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279232467 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:29:38.264771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c341f8bc-1fc2-4e4a-893a-01cfd6454d55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: .version_select at 0x7f1fe1dfc700>, body: {"keypair": {"name": "tempest-keypair-1989375120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFHPNOKrRFCXc4JSYCleC/xfNJukJgnBvlU9oQctiDjSv4dJhhHjnaQ9yjIItqzyvRii45nxIK3H2JYnkV4Z+po2mbcrZZfQuqLUr7oedBMsnY9vPa5xbovLHAdbt7ZgQ=="}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:38.281135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-c341f8bc-1fc2-4e4a-893a-01cfd6454d55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:29:38.284938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-c341f8bc-1fc2-4e4a-893a-01cfd6454d55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:29:38.385461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c341f8bc-1fc2-4e4a-893a-01cfd6454d55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124654 Aug 29 19:29:38.386185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 498/995] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:29:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:40.915754 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-422527738", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8927a541-9264-4ca6-885d-504e7408d7ca"}], "security_groups": [{"name": "tempest-securitygroup--234944214"}], "key_name": "tempest-keypair-1989375120", "user_data": "}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:41.027257 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] validate_networks() for [('8927a541-9264-4ca6-885d-504e7408d7ca', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:29:41.412108 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:29:41.412536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:29:41.413018 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:29:41.413429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:29:41.413841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:29:41.422773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:41.423261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:41.423695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:41.424612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:41.425072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:41.425499 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:41.443502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:29:41.447764 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:29:41.459297 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:29:41.461729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:29:41.615469 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-01099d32-dd0c-493a-adc9-7705efd3c802 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704495 Aug 29 19:29:41.616401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 498/996] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:29:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:29:41.627744 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e7ba9494-a111-44d9-a093-c3b08491ef63 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:41.628379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e7ba9494-a111-44d9-a093-c3b08491ef63 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:41.689070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e7ba9494-a111-44d9-a093-c3b08491ef63 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:41.697078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e7ba9494-a111-44d9-a093-c3b08491ef63 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1241 microversion: 2.1 time: 0.073057 Aug 29 19:29:41.697078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 499/997] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:41 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:42.720601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:42.721636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:42.729286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:42.729883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:42.733351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:42.733351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:42.733351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:42.733351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:42.796123 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:42.804180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b3ddf0d3-a488-419a-82a3-7e8d3d541959 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1245 microversion: 2.1 time: 0.090435 Aug 29 19:29:42.805288 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 499/998] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:42 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:43.826106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:43.826638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:43.833223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:43.833707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:43.834147 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:43.834848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:43.835300 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:43.835719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:43.902938 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:43.911550 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6728eeb3-fc13-4ed4-9a29-4ee894ba4aee tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1293 microversion: 2.1 time: 0.089456 Aug 29 19:29:43.912156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 500/999] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:43 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:44.933784 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:44.934391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:44.941859 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:44.942363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:44.942777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:44.948906 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:44.948906 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:44.948906 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:45.104957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:45.116097 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b5235550-c5af-47b2-9ce2-71dd7db57ccc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.186438 Aug 29 19:29:45.130662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 500/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:44 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:45.864435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-3ef3d8a3-da0e-4d3f-8090-56c66557ad2c req-89f01d0a-2a28-4118-ac7a-6272b5656193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec013e7d-3d9a-4441-bf85-56c8dfc5bca6", "tag": "199ba79f-483f-4f2d-8852-7ac8c137c986"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:45.875488 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-3ef3d8a3-da0e-4d3f-8090-56c66557ad2c req-89f01d0a-2a28-4118-ac7a-6272b5656193 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:45.875993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-3ef3d8a3-da0e-4d3f-8090-56c66557ad2c req-89f01d0a-2a28-4118-ac7a-6272b5656193 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:45.876468 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-3ef3d8a3-da0e-4d3f-8090-56c66557ad2c req-89f01d0a-2a28-4118-ac7a-6272b5656193 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:45.887784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-3ef3d8a3-da0e-4d3f-8090-56c66557ad2c req-89f01d0a-2a28-4118-ac7a-6272b5656193 service nova] Creating event network-changed:199ba79f-483f-4f2d-8852-7ac8c137c986 for instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 on hv-cinder-85501 Aug 29 19:29:45.893473 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-3ef3d8a3-da0e-4d3f-8090-56c66557ad2c req-89f01d0a-2a28-4118-ac7a-6272b5656193 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 Aug 29 19:29:45.894172 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 501/1001] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:46.145533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:46.146538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:46.152865 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:46.153415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:46.153876 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:46.154651 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:46.155100 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:46.155601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:46.295076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:46.304280 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fad20b94-26ce-4c68-a5d1-fb65a8247464 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.162555 Aug 29 19:29:46.304858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 501/1002] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:46 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:47.325721 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:47.326944 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:47.333023 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:47.333501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:47.333934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:47.334616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:47.335058 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:47.335476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:47.471848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:47.479569 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-41dbfd67-2f26-4c6b-a3d0-88bd22b6fef6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.158435 Aug 29 19:29:47.481878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 502/1003] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:47 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:48.500781 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:48.501354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:48.508025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:48.508510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:48.508944 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:48.509642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:48.510098 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:48.510521 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:48.640083 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:48.647652 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fc8d7e44-8b22-42e3-a083-0e9b16129f21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.150957 Aug 29 19:29:48.648244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 502/1004] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:48 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:49.668854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:49.670074 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:49.676521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:49.677000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:49.677584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:49.678275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:49.678729 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:49.679152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:49.815085 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:49.822707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c6969b82-2a2f-44de-a7c1-6a96cc887682 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.157842 Aug 29 19:29:49.823265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 503/1005] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:49 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:50.843571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:50.844205 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:50.850913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:50.851402 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:50.851836 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:50.852546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:50.853001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:50.853460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:50.983942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:50.992049 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fe05d639-1129-4b69-a97a-0ef0547c694a tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.152805 Aug 29 19:29:50.992621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 503/1006] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:50 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:51.504990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-0d690ae0-c437-4dac-a1d8-37e42faf54f6 req-287893a9-41cc-4dad-9b06-83582d87900b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec013e7d-3d9a-4441-bf85-56c8dfc5bca6", "name": "network-vif-plugged", "status": "completed", "tag": "199ba79f-483f-4f2d-8852-7ac8c137c986"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:51.515060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-0d690ae0-c437-4dac-a1d8-37e42faf54f6 req-287893a9-41cc-4dad-9b06-83582d87900b service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:51.515538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-0d690ae0-c437-4dac-a1d8-37e42faf54f6 req-287893a9-41cc-4dad-9b06-83582d87900b service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:51.516003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-0d690ae0-c437-4dac-a1d8-37e42faf54f6 req-287893a9-41cc-4dad-9b06-83582d87900b service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:51.528668 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-0d690ae0-c437-4dac-a1d8-37e42faf54f6 req-287893a9-41cc-4dad-9b06-83582d87900b service nova] Creating event network-vif-plugged:199ba79f-483f-4f2d-8852-7ac8c137c986 for instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 on hv-cinder-85501 Aug 29 19:29:51.534022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-0d690ae0-c437-4dac-a1d8-37e42faf54f6 req-287893a9-41cc-4dad-9b06-83582d87900b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Aug 29 19:29:51.534654 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 504/1007] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:29:52.012428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:52.013020 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:52.015511 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:52.016179 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:52.021364 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:52.021942 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:52.022372 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:52.023060 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:52.023507 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:52.024025 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:52.304477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:52.312120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-598d73c8-e357-4897-bba3-ccc8f20727d1 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.303554 Aug 29 19:29:52.312826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 504/1008] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:52 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:53.329184 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:53.333807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:53.334539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:53.336455 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:53.341371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:53.341886 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:53.342323 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:53.343040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:53.343495 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:53.343955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:53.479073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:53.487616 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-840cab17-fd68-420f-bdbd-5122f1ef4fbe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1366 microversion: 2.1 time: 0.159453 Aug 29 19:29:53.488214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 505/1009] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:53 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:29:53.620574 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dab0043-c606-412f-9ff9-e44c6222c7fc", "device": "/dev/sdb"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:53.623498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:53.629799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:53.630272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:53.630796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:53.631490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:53.631959 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:53.632379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:54.508138 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:54.508795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:54.515694 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:54.516200 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:54.516731 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:54.517428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:54.517879 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:54.518303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:54.649092 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:29:54.657732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6842032f-eb2c-4825-982e-23a76fcdaf2f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1556 microversion: 2.1 time: 0.153629 Aug 29 19:29:54.658322 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 506/1010] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:29:54 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:29:54.677369 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:29:54.677851 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:29:54.684114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:54.684602 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:54.685042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:54.685756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:54.686270 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:54.686708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:54.762963 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c61516ce-5838-40e7-a5ed-66ac0997864e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089270 Aug 29 19:29:54.764124 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 507/1011] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:29:54 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:29:54.814384 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6f9bdfe1-65cd-4b4b-85dc-3d348c1d5b7e tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "POST /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.197651 Aug 29 19:29:54.815059 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 505/1012] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:29:53 2022] POST /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f/os-volume_attachments => generated 194 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:29:56.020972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-2aec6db1-ed96-475c-9a38-4fe18943df32 req-671be80d-abba-4ee1-ad3f-6eb804d9fc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec013e7d-3d9a-4441-bf85-56c8dfc5bca6", "tag": "199ba79f-483f-4f2d-8852-7ac8c137c986"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:29:56.031006 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-2aec6db1-ed96-475c-9a38-4fe18943df32 req-671be80d-abba-4ee1-ad3f-6eb804d9fc3e service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:29:56.031486 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-2aec6db1-ed96-475c-9a38-4fe18943df32 req-671be80d-abba-4ee1-ad3f-6eb804d9fc3e service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:29:56.031942 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-2aec6db1-ed96-475c-9a38-4fe18943df32 req-671be80d-abba-4ee1-ad3f-6eb804d9fc3e service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:29:56.043213 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-2aec6db1-ed96-475c-9a38-4fe18943df32 req-671be80d-abba-4ee1-ad3f-6eb804d9fc3e service nova] Creating event network-changed:199ba79f-483f-4f2d-8852-7ac8c137c986 for instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 on hv-cinder-85501 Aug 29 19:29:56.048595 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-2aec6db1-ed96-475c-9a38-4fe18943df32 req-671be80d-abba-4ee1-ad3f-6eb804d9fc3e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Aug 29 19:29:56.058895 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 508/1013] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:21.201686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:21.202468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:21.206662 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:21.207247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:21.213418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:21.217232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:21.217232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:21.217232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:21.217232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:21.217595 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:21.299154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lazy-loading 'services' on Instance uuid 29e939ce-3fa7-462f-98e0-d3294571f23f {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:30:21.520612 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-06cdd5c7-2182-4cac-844d-06d13a130550 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "DELETE /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f/os-volume_attachments/0dab0043-c606-412f-9ff9-e44c6222c7fc" status: 202 len: 0 microversion: 2.1 time: 0.320106 Aug 29 19:30:21.521126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 506/1014] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:30:21 2022] DELETE /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f/os-volume_attachments/0dab0043-c606-412f-9ff9-e44c6222c7fc => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:30:23.699958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=7 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:23.701393 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=46 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:23.706794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:23.713379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:23.713379 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:23.713871 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:23.714303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:23.715018 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:23.715472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:23.716660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:23.742132 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:30:24.149576 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-9804cd2f-ca56-499f-b413-33783dc6c894 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "DELETE /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 204 len: 0 microversion: 2.1 time: 0.451049 Aug 29 19:30:24.150295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 509/1015] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:30:23 2022] DELETE /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:30:24.160435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:24.161172 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:24.168033 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:24.168553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:24.169709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:24.170441 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:24.170927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:24.171512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:24.306694 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:24.314310 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-741d561e-bd3c-4f77-bf2d-5108b9df120d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1508 microversion: 2.1 time: 0.158748 Aug 29 19:30:24.314858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 507/1016] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:24 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:25.335761 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:25.336435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:25.343556 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:25.344071 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:25.344504 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:25.345190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:25.345638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:25.346060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:25.473769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:25.481384 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-35f671fc-5c63-48ad-bf84-5203535f2af2 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1508 microversion: 2.1 time: 0.149968 Aug 29 19:30:25.481939 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 510/1017] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:25 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:26.503277 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:26.506291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:26.510449 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:26.510829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:26.511261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:26.511989 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:26.512444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:26.512860 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:26.650465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:26.658449 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1fdd5539-1dec-4905-836b-0af24ce9dd62 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1508 microversion: 2.1 time: 0.158978 Aug 29 19:30:26.659273 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 508/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:26 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:30:26.955269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-3a31e20e-bd17-4196-bea3-39e0e9747b54 req-52670d2c-19e1-4008-b7b7-54a070dc8c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e939ce-3fa7-462f-98e0-d3294571f23f", "name": "network-vif-deleted", "tag": "0a057393-9fa5-416e-b81b-8f9ca4ee4f03"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:26.965624 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-3a31e20e-bd17-4196-bea3-39e0e9747b54 req-52670d2c-19e1-4008-b7b7-54a070dc8c27 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:26.969034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-3a31e20e-bd17-4196-bea3-39e0e9747b54 req-52670d2c-19e1-4008-b7b7-54a070dc8c27 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:26.969034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-3a31e20e-bd17-4196-bea3-39e0e9747b54 req-52670d2c-19e1-4008-b7b7-54a070dc8c27 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:26.980157 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-3a31e20e-bd17-4196-bea3-39e0e9747b54 req-52670d2c-19e1-4008-b7b7-54a070dc8c27 service nova] Creating event network-vif-deleted:0a057393-9fa5-416e-b81b-8f9ca4ee4f03 for instance 29e939ce-3fa7-462f-98e0-d3294571f23f on hv-cinder-85501 Aug 29 19:30:26.985054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-3a31e20e-bd17-4196-bea3-39e0e9747b54 req-52670d2c-19e1-4008-b7b7-54a070dc8c27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033506 Aug 29 19:30:26.986118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 511/1019] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:27.680458 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:27.681073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:27.687583 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:27.688114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:27.688576 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:27.689309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:27.689770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:27.690197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:27.721365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:27.721853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:27.722316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:27.722927 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lazy-loading 'fault' on Instance uuid 29e939ce-3fa7-462f-98e0-d3294571f23f {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:30:27.771244 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:27.773136 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-017dc277-71a6-4d1d-9e13-f6c80e94922b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 200 len: 1304 microversion: 2.1 time: 0.096641 Aug 29 19:30:27.773692 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 509/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:27 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:28.796590 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:28.797284 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: 29e939ce-3fa7-462f-98e0-d3294571f23f] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:28.803321 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:28.803801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:28.804266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:28.804954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:28.805404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:28.805823 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:28.819835 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] HTTP exception thrown: Instance 29e939ce-3fa7-462f-98e0-d3294571f23f could not be found. Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Request method failure captured: Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f HTTP/1.1 Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRONJaDbv61Jiyh105-GK2QdC1h9RDLr9jMFICxJlACG4G6cTi6GDUDqkWO8CL18JCbyzjY-RpjKeypCmm8Vm62d1G6Om1QF00eQpn3V8jzxCZl0KI84rn1GIJ8laejQgCcyGPRKSGkoDyGGptOW0wJgtbKFoCJ8cHmvTU58gz-5HfM Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: b781311ee43640d9b485cbc915560b76 Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1242130159 Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:30:28.821444 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b781311ee43640d9b485cbc915560b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b781311ee43640d9b485cbc915560b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b781311ee43640d9b485cbc915560b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b781311ee43640d9b485cbc915560b76"}]}] Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-VolumesSnapshotTestJSON-1242130159 Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: b781311ee43640d9b485cbc915560b76 Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1242130159 Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-VolumesSnapshotTestJSON-1242130159-project Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: ec34a575c6c748989e3460350d07e36f Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-VolumesSnapshotTestJSON-1242130159-project Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 29e939ce-3fa7-462f-98e0-d3294571f23f could not be found. Aug 29 19:30:28.823158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '29e939ce-3fa7-462f-98e0-d3294571f23f'} Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e939ce-3fa7-462f-98e0-d3294571f23f could not be found. Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:30:28.833487 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e939ce-3fa7-462f-98e0-d3294571f23f could not be found. Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e939ce-3fa7-462f-98e0-d3294571f23f could not be found. Aug 29 19:30:28.834992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:30:28.836223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Returning 404 to user: Instance 29e939ce-3fa7-462f-98e0-d3294571f23f could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:30:28.836223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-dbe74dc1-3eb0-4b54-8ede-4411299ae43c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f" status: 404 len: 111 microversion: 2.1 time: 0.031670 Aug 29 19:30:28.836223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 512/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:28 2022] GET /compute/v2.1/servers/29e939ce-3fa7-462f-98e0-d3294571f23f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:30:39.644857 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1820764261", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "networks": [{"uuid": "a923276f-77f0-4dfb-a15d-8dd449f66658"}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:39.653840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=10 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:39.654580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:39.864446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] validate_networks() for [('a923276f-77f0-4dfb-a15d-8dd449f66658', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:30:40.223097 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:30:40.223515 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:30:40.224086 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:30:40.224488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:30:40.224896 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:30:40.234272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:40.241159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:40.241159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:40.241159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:40.241159 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:40.241564 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:40.253858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Getting quotas for project b781311ee43640d9b485cbc915560b76. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:30:40.257838 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Getting quotas for user ec34a575c6c748989e3460350d07e36f and project b781311ee43640d9b485cbc915560b76. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:30:40.269410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:30:40.271688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:30:40.560442 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:40.561083 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:40.563243 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:40.563916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:40.568609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:40.569094 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:40.569530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:40.570223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:40.570684 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:40.571114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:40.595052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2c8ff57a-68f4-4ab1-9e39-370877ec2cf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/ips" status: 200 len: 150 microversion: 2.1 time: 0.039144 Aug 29 19:30:40.595612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 513/1022] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:30:40 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:30:40.627955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-af5878fd-81db-400c-b10c-a0da1a412929 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987153 Aug 29 19:30:40.628642 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 510/1023] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:30:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:30:40.640366 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-35970750-daea-4683-9cc0-169efc5836e4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:40.641005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-35970750-daea-4683-9cc0-169efc5836e4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:40.812288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-35970750-daea-4683-9cc0-169efc5836e4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:40.819216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-35970750-daea-4683-9cc0-169efc5836e4 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1219 microversion: 2.1 time: 0.183625 Aug 29 19:30:40.819770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 514/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:40 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:41.839498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:41.840647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:41.847117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:41.847600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:41.848082 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:41.848933 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:41.850419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:41.850851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:41.917151 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:41.925459 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0b0949e7-0b6b-4c4a-a6b0-e86052a8d3d3 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1223 microversion: 2.1 time: 0.089838 Aug 29 19:30:41.926017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 511/1025] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:41 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:42.649794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eee3c69d-4173-427b-95b7-f2a7a1525a91"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:42.652871 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:42.661229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:42.666770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:42.666770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:42.666770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:42.666770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:42.667267 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:42.946776 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:42.947380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:42.954452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:42.954932 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:42.955357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:42.956077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:42.956527 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:42.956943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:43.022616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:43.031041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fda586a5-b481-4739-97b1-a4646437112c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1271 microversion: 2.1 time: 0.088467 Aug 29 19:30:43.031594 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 512/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:42 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:43.861368 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e71b59f8-2733-452c-a09c-99a063dd7736 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215589 Aug 29 19:30:43.865348 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 515/1027] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:30:42 2022] POST /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments => generated 194 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:44.052543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:44.053608 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:44.060789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:44.061267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:44.061803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:44.062502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:44.062947 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:44.063367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:44.144109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:44.151955 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3beed541-1089-45f8-911c-fbf62535d367 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1289 microversion: 2.1 time: 0.103819 Aug 29 19:30:44.152558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 513/1028] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:44 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:45.178363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:45.179076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:45.185316 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:45.185801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:45.186240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:45.186935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:45.187388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:45.187814 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:45.317507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:45.326229 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-dea4afc2-fe84-4c9a-8634-1f4455ff591d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.152636 Aug 29 19:30:45.326807 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 516/1029] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:45 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:45.729506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-8d254245-b1b7-47bd-984d-5f3a35d22442 req-3fe6511a-1571-49be-8004-f4396f10c516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac80a5d4-24ed-4cf0-9921-0ab6c566790e", "tag": "5b76cd79-f27e-4caa-b7b0-a8582aa63e04"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:45.741804 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-8d254245-b1b7-47bd-984d-5f3a35d22442 req-3fe6511a-1571-49be-8004-f4396f10c516 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:45.742286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-8d254245-b1b7-47bd-984d-5f3a35d22442 req-3fe6511a-1571-49be-8004-f4396f10c516 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:45.742782 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-8d254245-b1b7-47bd-984d-5f3a35d22442 req-3fe6511a-1571-49be-8004-f4396f10c516 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:45.754327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-8d254245-b1b7-47bd-984d-5f3a35d22442 req-3fe6511a-1571-49be-8004-f4396f10c516 service nova] Creating event network-changed:5b76cd79-f27e-4caa-b7b0-a8582aa63e04 for instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e on hv-cinder-85501 Aug 29 19:30:45.759498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-8d254245-b1b7-47bd-984d-5f3a35d22442 req-3fe6511a-1571-49be-8004-f4396f10c516 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Aug 29 19:30:45.760307 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 514/1030] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:46.352016 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:46.353323 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:46.360578 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:46.361166 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:46.361548 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:46.362283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:46.362736 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:46.363162 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:46.497346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:46.505030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7fc553d2-95ea-4475-8a43-5b62ce83c473 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.156902 Aug 29 19:30:46.505591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 517/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:46 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:47.526309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:47.527092 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:47.533706 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:47.534184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:47.534614 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:47.535309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:47.535759 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:47.536204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:47.670469 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:47.678328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-57453462-6f1f-47cc-9183-f95786beab90 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.156424 Aug 29 19:30:47.678882 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 515/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:47 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:48.698658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:48.704091 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:48.707063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:48.707645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:48.708358 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:48.709165 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:48.709923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:48.710407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:48.845852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:48.853570 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4b4ff326-cd9d-4603-aa2e-0be66cfb296d tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.158942 Aug 29 19:30:48.854133 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 518/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:48 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:49.875041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:49.875985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:49.888423 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:49.889009 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:49.889440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:49.890143 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:49.890590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:49.891005 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:50.022061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:50.029732 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-041ea885-8cd9-4701-a2f5-d8722211ac50 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.158608 Aug 29 19:30:50.030291 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 516/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:49 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:51.051400 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:51.052060 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:51.054435 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:51.059677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:51.060192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:51.060629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:51.061339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:51.061794 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:51.062220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:51.199009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:51.206988 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a4e74a3b-7f3e-4e76-abe9-87dd777be729 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.159459 Aug 29 19:30:51.207547 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 519/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:51 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:30:51.763842 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-e592b41b-32fa-483b-9fb8-b9ed3e8cd99b req-edb073ab-1574-4ba6-9871-09b834d13759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac80a5d4-24ed-4cf0-9921-0ab6c566790e", "name": "network-vif-plugged", "status": "completed", "tag": "5b76cd79-f27e-4caa-b7b0-a8582aa63e04"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:51.768842 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:51.769511 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:51.775197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e592b41b-32fa-483b-9fb8-b9ed3e8cd99b req-edb073ab-1574-4ba6-9871-09b834d13759 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:51.775668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e592b41b-32fa-483b-9fb8-b9ed3e8cd99b req-edb073ab-1574-4ba6-9871-09b834d13759 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:51.776114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e592b41b-32fa-483b-9fb8-b9ed3e8cd99b req-edb073ab-1574-4ba6-9871-09b834d13759 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:51.787195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-e592b41b-32fa-483b-9fb8-b9ed3e8cd99b req-edb073ab-1574-4ba6-9871-09b834d13759 service nova] Creating event network-vif-plugged:5b76cd79-f27e-4caa-b7b0-a8582aa63e04 for instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e on hv-cinder-85501 Aug 29 19:30:51.792387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-e592b41b-32fa-483b-9fb8-b9ed3e8cd99b req-edb073ab-1574-4ba6-9871-09b834d13759 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Aug 29 19:30:51.796036 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 517/1036] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:52.227522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:52.228266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:52.235670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.236274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.238422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.238422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.238422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.238846 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.386288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:52.396234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-beb17133-f292-42c4-94e6-3f97494395df tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.172557 Aug 29 19:30:52.408989 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 520/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:52 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:52.445422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eee3c69d-4173-427b-95b7-f2a7a1525a91"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:52.447757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:52.454616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.455106 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.455538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.456363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.456845 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.457272 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.538552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Invalid volume: volume eee3c69d-4173-427b-95b7-f2a7a1525a91 is already attached to instances: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: POST /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments HTTP/1.1 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 74 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:30:52.540286 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {"volumeAttachment": {"volumeId": "eee3c69d-4173-427b-95b7-f2a7a1525a91"}} Aug 29 19:30:52.542024 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Invalid volume: volume eee3c69d-4173-427b-95b7-f2a7a1525a91 is already attached to instances: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'server_id': 'ec013e7d-3d9a-4441-bf85-56c8dfc5bca6', 'body': {'volumeAttachment': {'volumeId': 'eee3c69d-4173-427b-95b7-f2a7a1525a91'}}} Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eee3c69d-4173-427b-95b7-f2a7a1525a91 is already attached to instances: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:30:52.543567 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eee3c69d-4173-427b-95b7-f2a7a1525a91 is already attached to instances: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:30:52.544943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eee3c69d-4173-427b-95b7-f2a7a1525a91 is already attached to instances: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 400 to user: Invalid volume: volume eee3c69d-4173-427b-95b7-f2a7a1525a91 is already attached to instances: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b922f244-22cd-4efe-9a61-c06336e4c782 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101761 Aug 29 19:30:52.546826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 518/1038] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:30:52 2022] POST /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:30:52.611513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:52.612053 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:52.620122 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.620645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.621244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.622339 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.623088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.623526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.712351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'services' on Instance uuid ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:30:52.924509 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c201bcee-3c91-43aa-8c05-6a23df402743 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments/eee3c69d-4173-427b-95b7-f2a7a1525a91" status: 202 len: 0 microversion: 2.1 time: 0.319171 Aug 29 19:30:52.925126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 521/1039] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:30:52 2022] DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments/eee3c69d-4173-427b-95b7-f2a7a1525a91 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:30:52.933444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:52.942835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:52.942835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.943280 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.943714 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.944444 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:52.944894 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:52.945314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:52.977053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0d7d9fd8-f457-4ce6-80d4-86d0eaf3e05d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Aug 29 19:30:52.977053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 519/1040] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:30:52 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:53.420280 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:53.421021 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:53.427413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:53.427926 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:53.428368 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:53.429078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:53.429538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:53.429967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:53.561958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:53.569769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-52d27443-9c17-493a-b5a1-43599d642b78 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1319 microversion: 2.1 time: 0.154874 Aug 29 19:30:53.570352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 522/1041] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:53 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:53.988796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:53.991252 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:53.997962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:53.998452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:53.998886 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:53.999590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:54.000072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:54.000499 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:54.030517 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-791fe4f7-9d27-4a9d-bd28-593276f3ef71 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Aug 29 19:30:54.031073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 520/1042] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:30:53 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:54.590649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:54.591259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:54.597795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:54.598276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:54.598707 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:54.599404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:54.599870 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:54.600307 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:54.731030 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:54.738857 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f789122f-3dcf-419f-9c4d-a107016421bf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1508 microversion: 2.1 time: 0.152150 Aug 29 19:30:54.739670 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 523/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:54 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:54.760525 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd3439b4-db63-4f38-bca0-05657c147adb", "device": "/dev/sdb"}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:54.763500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:54.773359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:54.773359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:54.773359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:54.773359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:54.773796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:54.773796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.043128 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:55.045453 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:55.062390 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:55.064084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:55.064084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.064084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:55.064489 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:55.064914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.100034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a9ef9d5f-db6e-463c-9e07-ac9dfdeaa53b tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060762 Aug 29 19:30:55.100620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 524/1044] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:30:55 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:30:55.171431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:55.171971 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:55.179218 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:55.179703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:55.180166 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.180873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:55.181476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:55.181910 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.208213 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:30:55.534547 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3de5f686-51b3-4189-9da1-0f8ce2047b51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 204 len: 0 microversion: 2.1 time: 0.367574 Aug 29 19:30:55.535194 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 525/1045] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:30:55 2022] DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:30:55.543540 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:55.544263 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:55.550084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:55.550569 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:55.551009 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.551741 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:55.552268 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:55.552671 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:55.609449 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b60458db-2573-4994-978a-182b665b50ee tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "POST /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853090 Aug 29 19:30:55.610264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 521/1046] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:30:54 2022] POST /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:55.686835 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:55.694494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7a74e2ea-299b-436d-96ac-98ff7b21df51 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1681 microversion: 2.1 time: 0.154936 Aug 29 19:30:55.695054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 526/1047] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:55 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:30:56.718397 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:56.718397 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:56.723770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:56.724282 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:56.724719 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:56.725450 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:56.725910 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:56.726354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:56.858817 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:56.866840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c11db215-a974-43d9-9c88-a13018868801 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1681 microversion: 2.1 time: 0.155661 Aug 29 19:30:56.867404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 522/1048] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:56 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:57.888312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:57.889031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:57.895658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:57.896306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:57.896696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:57.897395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:57.897848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:57.898274 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:57.902884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:58.034631 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:58.042762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-827cdd0e-f40c-47dc-87ae-42a944bf2015 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1681 microversion: 2.1 time: 0.158549 Aug 29 19:30:58.043367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 527/1049] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:57 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:30:58.574465 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-f32de0d6-a43f-4dca-bf4d-cbea116860e9 req-f082d310-cadc-4002-b70d-e83ffe218027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec013e7d-3d9a-4441-bf85-56c8dfc5bca6", "name": "network-vif-deleted", "tag": "199ba79f-483f-4f2d-8852-7ac8c137c986"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:30:58.585422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f32de0d6-a43f-4dca-bf4d-cbea116860e9 req-f082d310-cadc-4002-b70d-e83ffe218027 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:58.587041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f32de0d6-a43f-4dca-bf4d-cbea116860e9 req-f082d310-cadc-4002-b70d-e83ffe218027 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:58.587041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-f32de0d6-a43f-4dca-bf4d-cbea116860e9 req-f082d310-cadc-4002-b70d-e83ffe218027 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:58.599514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-f32de0d6-a43f-4dca-bf4d-cbea116860e9 req-f082d310-cadc-4002-b70d-e83ffe218027 service nova] Creating event network-vif-deleted:199ba79f-483f-4f2d-8852-7ac8c137c986 for instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 on hv-cinder-85501 Aug 29 19:30:58.604584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-f32de0d6-a43f-4dca-bf4d-cbea116860e9 req-f082d310-cadc-4002-b70d-e83ffe218027 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035535 Aug 29 19:30:58.605356 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 523/1050] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:30:59.063920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:30:59.064537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:30:59.071140 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:59.071612 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:59.072078 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:59.072782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:59.073240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:59.073745 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:59.106521 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:30:59.107006 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:30:59.108015 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:30:59.108472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'fault' on Instance uuid ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:30:59.155005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:30:59.165337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b3a3209a-9070-4459-bde6-12b55a515a55 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 200 len: 1331 microversion: 2.1 time: 0.105390 Aug 29 19:30:59.168447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 528/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:30:59 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:00.189811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:00.190533 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:00.197499 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:00.197988 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:00.198426 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:00.199639 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:00.200124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:00.200557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:00.213820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 HTTP/1.1 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:31:00.216132 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:31:00.217791 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'ec013e7d-3d9a-4441-bf85-56c8dfc5bca6'} Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:31:00.218631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:31:00.219930 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:00.221114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:31:00.221114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a32c8111-0585-46fc-a0ff-9f4a5efe4c15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 404 len: 111 microversion: 2.1 time: 0.032150 Aug 29 19:31:00.221114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 524/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:00 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:31:00.226540 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-89bd6d06-9816-4e4d-b161-433a8bf9790f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '.version_select at 0x7f1fe1d29670>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:00.388799 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-89bd6d06-9816-4e4d-b161-433a8bf9790f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989375120" status: 202 len: 0 microversion: 2.1 time: 0.166061 Aug 29 19:31:00.389373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 529/1053] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 19:31:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989375120 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:31:01.166684 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fa2f4297-5f84-4c7f-bd6c-dbda9c2551fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: .version_select at 0x7f1fde37d1f0>, body: {"keypair": {"name": "tempest-keypair-1326389638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAV1wnWdtTBTgrolmpD7DqE84YGdCdstXSBt2G94DhM3AZZNQNCU8dmT0KIMGGbwmqnZInLKImAsl5v5ltQhLchfVmuXFHTZZmARbd9WJkX80w1zOr7O5hnVpVrBijO4w=="}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:31:01.182243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-fa2f4297-5f84-4c7f-bd6c-dbda9c2551fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:31:01.186054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-fa2f4297-5f84-4c7f-bd6c-dbda9c2551fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:31:01.319462 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fa2f4297-5f84-4c7f-bd6c-dbda9c2551fe tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156613 Aug 29 19:31:01.325877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 525/1054] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:31:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:31:03.909967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:31:03.910485 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Mon Aug 29 19:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 19:31:03.915149 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1502093547", "imageRef": "a8762b9d-be65-4e3c-accf-b72a633a91cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8927a541-9264-4ca6-885d-504e7408d7ca"}], "security_groups": [{"name": "tempest-securitygroup--1355605331"}], "key_name": "tempest-keypair-1326389638", "user_data": "}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:31:04.021649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] validate_networks() for [('8927a541-9264-4ca6-885d-504e7408d7ca', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:31:04.412215 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:31:04.412628 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:31:04.413105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:31:04.413509 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:31:04.413923 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:31:04.422862 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:04.423344 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:04.423781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:04.424545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:04.425004 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:04.425428 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:04.442935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:31:04.446925 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Getting quotas for user 9c0c242c0ad048eb8fd35b4671704056 and project 68d8a00f546547178af95e8645c928e7. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:31:04.458751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:31:04.461079 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8762b9d-be65-4e3c-accf-b72a633a91cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:31:04.586231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ae3d2999-654e-4b61-8bd1-d14246c1f784 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678102 Aug 29 19:31:04.586892 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 530/1055] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:31:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:31:04.598809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1b4cf9c9-beeb-4e31-9ba7-4edba0b61823 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:04.599464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1b4cf9c9-beeb-4e31-9ba7-4edba0b61823 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:04.666151 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1b4cf9c9-beeb-4e31-9ba7-4edba0b61823 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:04.674493 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1b4cf9c9-beeb-4e31-9ba7-4edba0b61823 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1242 microversion: 2.1 time: 0.079752 Aug 29 19:31:04.675956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 526/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:04 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:05.695547 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:05.696186 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:05.702978 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:05.703491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:05.711763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:05.711763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:05.711763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:05.711763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:05.771696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:05.780185 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d6192cda-476a-43cd-b290-9d2aa0e8b0a9 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1246 microversion: 2.1 time: 0.088586 Aug 29 19:31:05.780748 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 531/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:05 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:06.800740 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:06.801343 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:06.808273 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:06.808751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:06.809182 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:06.809871 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:06.810316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:06.810742 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:06.871467 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:06.879214 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-88b43282-e261-41c1-b8fd-b0a090f6b008 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1238 microversion: 2.1 time: 0.082259 Aug 29 19:31:06.879704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 527/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:06 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:07.900317 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:07.900873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:07.907835 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:07.908343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:07.908775 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:07.909461 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:07.909912 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:07.910335 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:07.972551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:07.980294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5b14bd58-fe64-4db8-8ffa-3fd4825507b6 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1238 microversion: 2.1 time: 0.083957 Aug 29 19:31:07.980856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 532/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:07 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:09.000708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:09.001481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:09.008112 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:09.008589 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:09.009016 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:09.009697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:09.010142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:09.010558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:09.074767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:09.082710 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3fc28948-6646-460d-84ea-0632f4080a5e tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1294 microversion: 2.1 time: 0.085889 Aug 29 19:31:09.083260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 528/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:08 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:10.103760 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:10.104440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:10.110970 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:10.111451 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:10.113120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:10.113120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:10.113120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:10.113466 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:10.195708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:10.208516 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-15660ac0-f25b-462f-829d-6852d1732f23 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1300 microversion: 2.1 time: 0.108632 Aug 29 19:31:10.215816 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 533/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:10 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:11.232718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:11.233342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:11.237405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:11.241326 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:11.241819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:11.242253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:11.242961 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:11.243414 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:11.244026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:11.248422 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:11.365460 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-cd20f0cb-a2ce-4140-9927-4f27b3c9f663 req-d293944e-bfa3-43bc-bcd1-baa1de1efccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a77c2c3-1d37-405e-9f1a-536277e8f213", "tag": "c35d3b82-5f2d-434e-946e-6e2dd228defb"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:31:11.374733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:11.376515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-cd20f0cb-a2ce-4140-9927-4f27b3c9f663 req-d293944e-bfa3-43bc-bcd1-baa1de1efccc service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:11.377188 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-cd20f0cb-a2ce-4140-9927-4f27b3c9f663 req-d293944e-bfa3-43bc-bcd1-baa1de1efccc service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:11.377773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-cd20f0cb-a2ce-4140-9927-4f27b3c9f663 req-d293944e-bfa3-43bc-bcd1-baa1de1efccc service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:11.383174 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4acaf799-a09b-44c4-8a7b-2ab816f46b45 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.155180 Aug 29 19:31:11.387231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 529/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:11 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:11.389045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-cd20f0cb-a2ce-4140-9927-4f27b3c9f663 req-d293944e-bfa3-43bc-bcd1-baa1de1efccc service nova] Creating event network-changed:c35d3b82-5f2d-434e-946e-6e2dd228defb for instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 on hv-cinder-85501 Aug 29 19:31:11.398152 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-cd20f0cb-a2ce-4140-9927-4f27b3c9f663 req-d293944e-bfa3-43bc-bcd1-baa1de1efccc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036796 Aug 29 19:31:11.398902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 534/1063] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:31:12.405237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:12.405853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:12.413260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:12.413761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:12.414196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:12.414888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:12.415345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:12.415769 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:12.545175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:12.552797 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fdeffd56-0190-4aa7-85db-029890c98f6d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.151859 Aug 29 19:31:12.553344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 530/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:12 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:13.575509 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:13.576145 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:13.578042 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:13.582896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:13.583269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:13.583703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:13.584407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:13.584848 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:13.585264 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:13.721295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:13.729697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-6562a6d2-7aa4-4808-98a8-3b0236764742 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.158921 Aug 29 19:31:13.739455 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 535/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:13 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:31:14.751124 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:14.751728 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:14.754101 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:14.758755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:14.759232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:14.759693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:14.760792 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:14.761396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:14.761396 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:14.896259 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:14.906916 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-7b1c6b70-e66b-42c9-9875-c91ea62e02ff tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.159679 Aug 29 19:31:14.907490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 531/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:14 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:15.927249 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:15.927884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:15.929649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:15.930302 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=6 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:15.935715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:15.937687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:15.937687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:15.937687 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:15.937983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:15.938173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:16.073906 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:16.082192 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-588702b0-1c86-4473-9046-95e6e1b0e898 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.159099 Aug 29 19:31:16.082753 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 536/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:15 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:17.102459 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:17.103066 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:17.110120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:17.110603 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:17.111030 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:17.111715 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:17.112200 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:17.112611 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:17.241063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:17.249911 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-d05cb292-12f6-426d-8ce6-1821e4362513 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.151210 Aug 29 19:31:17.250408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 532/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:17 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:17.921786 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:17.922391 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:17.930326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:17.930886 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:17.931327 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:17.932047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:17.932501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:17.932924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:18.014526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lazy-loading 'services' on Instance uuid ac80a5d4-24ed-4cf0-9921-0ab6c566790e {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:31:18.236199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cd9d3786-4a49-4419-aa16-dcffb9f66904 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e/os-volume_attachments/fd3439b4-db63-4f38-bca0-05657c147adb" status: 202 len: 0 microversion: 2.1 time: 0.318153 Aug 29 19:31:18.236885 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 537/1069] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:31:17 2022] DELETE /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e/os-volume_attachments/fd3439b4-db63-4f38-bca0-05657c147adb => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:31:18.270276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:18.270897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:18.277390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:18.277876 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:18.278317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:18.279016 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:18.279472 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:18.279937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:18.409568 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:18.417695 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c8604837-d308-4071-bb29-0e5d108e3320 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.151277 Aug 29 19:31:18.418281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 533/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:18 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:19.439702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:19.442897 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:19.447608 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:19.449003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:19.449591 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:19.450303 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:19.450784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:19.451209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:19.544254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-2fa9b453-a798-4b64-abd0-c78b71343d3a req-443bcd0a-04b6-4da0-9965-9725ce6b5e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a77c2c3-1d37-405e-9f1a-536277e8f213", "name": "network-vif-plugged", "status": "completed", "tag": "c35d3b82-5f2d-434e-946e-6e2dd228defb"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:31:19.555041 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-2fa9b453-a798-4b64-abd0-c78b71343d3a req-443bcd0a-04b6-4da0-9965-9725ce6b5e27 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:19.555548 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-2fa9b453-a798-4b64-abd0-c78b71343d3a req-443bcd0a-04b6-4da0-9965-9725ce6b5e27 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:19.556001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-2fa9b453-a798-4b64-abd0-c78b71343d3a req-443bcd0a-04b6-4da0-9965-9725ce6b5e27 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:19.567432 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-2fa9b453-a798-4b64-abd0-c78b71343d3a req-443bcd0a-04b6-4da0-9965-9725ce6b5e27 service nova] Creating event network-vif-plugged:c35d3b82-5f2d-434e-946e-6e2dd228defb for instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 on hv-cinder-85501 Aug 29 19:31:19.572516 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-2fa9b453-a798-4b64-abd0-c78b71343d3a req-443bcd0a-04b6-4da0-9965-9725ce6b5e27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Aug 29 19:31:19.573847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 534/1071] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:31:19.598259 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:19.606421 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5ea75732-2023-4088-9153-6cf232a971e5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.171552 Aug 29 19:31:19.607024 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 538/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:19 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:20.412204 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:20.412789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:20.419471 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:20.419985 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:20.420420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:20.421109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:20.421558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:20.421975 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:20.447572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:31:20.628102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:20.628679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:20.635084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:20.636246 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:20.636662 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:20.637417 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:20.637842 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:20.638269 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:20.769367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:20.777202 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4661d53a-507d-48be-9177-3e65786f46fa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.153074 Aug 29 19:31:20.777809 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 539/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:20 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:20.820666 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-44b4f10e-999c-45d2-8aff-b4a670b565dd tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 204 len: 0 microversion: 2.1 time: 0.412530 Aug 29 19:31:20.821328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 535/1074] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:31:20 2022] DELETE /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:31:20.830318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:20.830924 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:20.836934 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:20.837412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:20.837845 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:20.838538 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:20.838994 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:20.839426 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:20.977086 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:20.985659 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-43fe2950-6729-47fa-800d-8549a2cc2a04 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1514 microversion: 2.1 time: 0.159182 Aug 29 19:31:20.986674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 540/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:20 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:31:21.798404 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:21.799104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:21.805748 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:21.806231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:21.806667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:21.807387 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:21.807907 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:21.808338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:21.935914 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:21.943506 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1b416d48-cd3c-45d6-9531-2ad2ce45aede tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.149531 Aug 29 19:31:21.944114 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 536/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:21 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:22.008404 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:22.009052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:22.016321 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:22.016803 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:22.017245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:22.017943 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:22.018398 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:22.018823 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:22.147833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:22.156033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fb590afd-4450-4ae2-ae8d-9b0e2e0c8430 tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1514 microversion: 2.1 time: 0.151701 Aug 29 19:31:22.156594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 541/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:22 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:22.964655 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:22.965249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:22.971632 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:22.972180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:22.972577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:22.973271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:22.973726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:22.974149 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:23.105189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:23.112883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c8d0f911-a854-4e17-b258-b74fad207ea0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1368 microversion: 2.1 time: 0.152170 Aug 29 19:31:23.113446 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 537/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:22 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:23.177680 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:23.178286 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:23.190458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:23.190458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:23.190458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:23.190458 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:23.190907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:23.190907 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:23.318935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:23.327215 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fdfec541-8f1b-4cc4-a9ff-e06871731ccf tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1514 microversion: 2.1 time: 0.153411 Aug 29 19:31:23.327802 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 542/1079] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:23 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:31:24.118502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-da9e6531-1ae4-4eaa-835b-31f06d3a8d03 req-1b363412-4d79-41dd-b365-1450961ce58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac80a5d4-24ed-4cf0-9921-0ab6c566790e", "name": "network-vif-deleted", "tag": "5b76cd79-f27e-4caa-b7b0-a8582aa63e04"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:31:24.129072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-da9e6531-1ae4-4eaa-835b-31f06d3a8d03 req-1b363412-4d79-41dd-b365-1450961ce58c service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.131939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-da9e6531-1ae4-4eaa-835b-31f06d3a8d03 req-1b363412-4d79-41dd-b365-1450961ce58c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.131939 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-da9e6531-1ae4-4eaa-835b-31f06d3a8d03 req-1b363412-4d79-41dd-b365-1450961ce58c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.133582 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:24.134221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:24.140112 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.140604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.141035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.141732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.142304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.142610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.143367 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-da9e6531-1ae4-4eaa-835b-31f06d3a8d03 req-1b363412-4d79-41dd-b365-1450961ce58c service nova] Creating event network-vif-deleted:5b76cd79-f27e-4caa-b7b0-a8582aa63e04 for instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e on hv-cinder-85501 Aug 29 19:31:24.150019 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-da9e6531-1ae4-4eaa-835b-31f06d3a8d03 req-1b363412-4d79-41dd-b365-1450961ce58c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035435 Aug 29 19:31:24.150722 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 538/1080] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:31:24.277367 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:24.285250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e7a65e06-b2b2-4afb-af32-df0ef2dbce3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1558 microversion: 2.1 time: 0.155502 Aug 29 19:31:24.285805 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 543/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:24 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:31:24.305957 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:24.306575 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:24.313348 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.313835 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.314270 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.314972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.315416 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.315833 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.349190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:24.349801 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:24.361190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.361190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.361190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.361190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:24.361693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:24.361693 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:24.396647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-783da2cb-e01b-4836-a8d9-50d8e6a805ab tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095181 Aug 29 19:31:24.397236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 539/1082] 10.222.0.62 () {58 vars in 1275 bytes} [Mon Aug 29 19:31:24 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:31:24.426233 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec34a575c6c748989e3460350d07e36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b781311ee43640d9b485cbc915560b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:31:24.434297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ef3e28ed-20ae-454a-96c4-1a9553b9cd1c tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 200 len: 1304 microversion: 2.1 time: 0.089058 Aug 29 19:31:24.434857 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 544/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:24 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:31:25.456488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:31:25.457276 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] [instance: ac80a5d4-24ed-4cf0-9921-0ab6c566790e] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:31:25.464640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:25.465302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:25.465844 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:25.466806 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:25.467339 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:25.467839 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:25.483260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] HTTP exception thrown: Instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e could not be found. Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Request method failure captured: Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e HTTP/1.1 Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRONJaDbv61Jiyh105-GK2QdC1h9RDLr9jMFICxJlACG4G6cTi6GDUDqkWO8CL18JCbyzjY-RpjKeypCmm8Vm62d1G6Om1QF00eQpn3V8jzxCZl0KI84rn1GIJ8laejQgCcyGPRKSGkoDyGGptOW0wJgtbKFoCJ8cHmvTU58gz-5HfM Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: b781311ee43640d9b485cbc915560b76 Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1242130159 Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:31:25.485161 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b781311ee43640d9b485cbc915560b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b781311ee43640d9b485cbc915560b76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b781311ee43640d9b485cbc915560b76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b781311ee43640d9b485cbc915560b76"}]}] Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-VolumesSnapshotTestJSON-1242130159 Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: b781311ee43640d9b485cbc915560b76 Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1242130159 Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-VolumesSnapshotTestJSON-1242130159-project Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: ec34a575c6c748989e3460350d07e36f Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-VolumesSnapshotTestJSON-1242130159-project Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e could not be found. Aug 29 19:31:25.486929 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'ac80a5d4-24ed-4cf0-9921-0ab6c566790e'} Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e could not be found. Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:31:25.488099 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e could not be found. Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e could not be found. Aug 29 19:31:25.490328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:31:25.491556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] Returning 404 to user: Instance ac80a5d4-24ed-4cf0-9921-0ab6c566790e could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:31:25.491556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e007fbc5-1fc0-4b05-a832-66d4a332ad5b tempest-VolumesSnapshotTestJSON-1242130159 tempest-VolumesSnapshotTestJSON-1242130159-project] 10.222.0.62 "GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e" status: 404 len: 111 microversion: 2.1 time: 0.036462 Aug 29 19:31:25.491556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 540/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:31:25 2022] GET /compute/v2.1/servers/ac80a5d4-24ed-4cf0-9921-0ab6c566790e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:31:26.164113 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-8900944d-97b1-4d54-ad04-d35df502e221 req-a1def7e0-07d5-4bcc-9ad8-f5373865bb94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a77c2c3-1d37-405e-9f1a-536277e8f213", "tag": "c35d3b82-5f2d-434e-946e-6e2dd228defb"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:31:26.175260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8900944d-97b1-4d54-ad04-d35df502e221 req-a1def7e0-07d5-4bcc-9ad8-f5373865bb94 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:31:26.175715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8900944d-97b1-4d54-ad04-d35df502e221 req-a1def7e0-07d5-4bcc-9ad8-f5373865bb94 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:31:26.176170 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-8900944d-97b1-4d54-ad04-d35df502e221 req-a1def7e0-07d5-4bcc-9ad8-f5373865bb94 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:31:26.180048 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:26.188175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-8900944d-97b1-4d54-ad04-d35df502e221 req-a1def7e0-07d5-4bcc-9ad8-f5373865bb94 service nova] Creating event network-changed:c35d3b82-5f2d-434e-946e-6e2dd228defb for instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 on hv-cinder-85501 Aug 29 19:31:26.193374 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-8900944d-97b1-4d54-ad04-d35df502e221 req-a1def7e0-07d5-4bcc-9ad8-f5373865bb94 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032986 Aug 29 19:31:26.194146 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 545/1085] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:32:01.479530 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:01.480292 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:01.703028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:01.703517 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:01.709597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:01.710073 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:01.710500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:01.711184 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:01.712180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:01.712601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:01.736380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-69349da8-0955-43f5-9d9c-e8ebf86dff52 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/ips" status: 200 len: 150 microversion: 2.1 time: 0.262357 Aug 29 19:32:01.736923 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 541/1086] 10.222.0.62 () {58 vars in 1248 bytes} [Mon Aug 29 19:32:01 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/ips => generated 150 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:32:03.657958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3444dba-6be1-4b92-bc99-bbe4c530add1"}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:32:03.660391 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:03.662546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=21 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:03.668273 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:03.668755 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:03.669191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:03.669884 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:03.670334 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:03.670758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:04.619962 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4fc95827-f886-49f3-9023-40727320662d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "POST /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966531 Aug 29 19:32:04.620959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 546/1087] 10.222.0.62 () {60 vars in 1323 bytes} [Mon Aug 29 19:32:03 2022] POST /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:32:13.299378 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:13.299914 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:13.302435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:13.303128 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:13.307772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:13.308311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:13.308751 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:13.309466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:13.309925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:13.310350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:13.392261 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'services' on Instance uuid 6a77c2c3-1d37-405e-9f1a-536277e8f213 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:32:13.658373 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b9bbbb24-4b22-4554-a28a-2f395fcf47d0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments/f3444dba-6be1-4b92-bc99-bbe4c530add1" status: 202 len: 0 microversion: 2.1 time: 0.362675 Aug 29 19:32:13.659010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 542/1088] 10.222.0.62 () {58 vars in 1416 bytes} [Mon Aug 29 19:32:13 2022] DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments/f3444dba-6be1-4b92-bc99-bbe4c530add1 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:32:13.669287 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:13.671697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:13.677896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:13.678360 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:13.678789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:13.679629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:13.680108 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:13.680559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:13.710515 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-75915404-3910-4ab0-a0eb-c26ebf0fb6ba tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046371 Aug 29 19:32:13.711979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 547/1089] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:32:13 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:32:14.725775 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:14.728395 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:14.734572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:14.735965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:14.735965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:14.736301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:14.736761 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:14.737189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:14.769327 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-77a220a4-4979-41be-8b48-2b31e70d7e19 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048602 Aug 29 19:32:14.769883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 543/1090] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:32:14 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:32:15.781026 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:15.783204 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:15.789732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:15.790211 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:15.790649 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:15.791336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:15.791789 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:15.792242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:15.822951 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a840b41a-919e-4130-93a6-6fd992c7faf5 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045866 Aug 29 19:32:15.823495 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 548/1091] 10.222.0.62 () {58 vars in 1302 bytes} [Mon Aug 29 19:32:15 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:32:15.885827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:15.886345 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:15.892875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:15.893361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:15.893796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:15.894549 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:15.894979 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:15.895405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:15.921231 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:32:16.232267 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-20b9fb22-12fb-42f4-85e0-afd953b88d15 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 204 len: 0 microversion: 2.1 time: 0.350576 Aug 29 19:32:16.232853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 544/1092] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:32:15 2022] DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:32:16.241388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:16.242073 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:16.248840 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:16.252277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:16.252277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:16.252277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:16.252277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:16.252703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:16.388922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:32:16.396637 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-97955dcd-5fde-4cf5-ab05-e33bc0530a21 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1683 microversion: 2.1 time: 0.159486 Aug 29 19:32:16.397172 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 549/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:16 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:32:17.418708 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:17.419485 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:17.426079 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:17.426566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:17.427004 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:17.427712 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:17.428212 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:17.428648 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:17.567085 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:32:17.575725 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-67f32ef7-14dd-471a-b1af-2f05883351d4 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1683 microversion: 2.1 time: 0.161435 Aug 29 19:32:17.576318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 545/1094] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:17 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:32:18.596594 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:18.597190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:18.604611 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:18.605106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:18.605543 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:18.606245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:18.606700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:18.607126 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:18.750177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:32:18.761498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-cd752e6d-b128-45af-8d92-2f5bb2d57bc0 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1683 microversion: 2.1 time: 0.169007 Aug 29 19:32:18.761958 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 550/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:18 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:32:19.141915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-c9c07aa5-3778-4e7d-a309-420b974952ec req-567276f8-9fe4-4d78-bdfa-910c345bbc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a77c2c3-1d37-405e-9f1a-536277e8f213", "name": "network-vif-deleted", "tag": "c35d3b82-5f2d-434e-946e-6e2dd228defb"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:32:19.152069 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c9c07aa5-3778-4e7d-a309-420b974952ec req-567276f8-9fe4-4d78-bdfa-910c345bbc40 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:19.152607 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c9c07aa5-3778-4e7d-a309-420b974952ec req-567276f8-9fe4-4d78-bdfa-910c345bbc40 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:19.153236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c9c07aa5-3778-4e7d-a309-420b974952ec req-567276f8-9fe4-4d78-bdfa-910c345bbc40 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:19.164913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-c9c07aa5-3778-4e7d-a309-420b974952ec req-567276f8-9fe4-4d78-bdfa-910c345bbc40 service nova] Creating event network-vif-deleted:c35d3b82-5f2d-434e-946e-6e2dd228defb for instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 on hv-cinder-85501 Aug 29 19:32:19.170053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-c9c07aa5-3778-4e7d-a309-420b974952ec req-567276f8-9fe4-4d78-bdfa-910c345bbc40 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104421 Aug 29 19:32:19.171460 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 546/1096] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:32:19.785099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:19.785563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:19.792797 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:19.793551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:19.794189 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:19.795187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:19.795901 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:19.796557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:19.829647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:19.830110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:19.830545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:19.830987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lazy-loading 'fault' on Instance uuid 6a77c2c3-1d37-405e-9f1a-536277e8f213 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:32:19.875661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0c242c0ad048eb8fd35b4671704056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d8a00f546547178af95e8645c928e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:32:19.884063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5659042b-0631-4059-9966-2545afa8db26 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 200 len: 1332 microversion: 2.1 time: 0.103009 Aug 29 19:32:19.884733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 551/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:19 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:32:20.906565 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:20.907247 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:20.913412 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:20.915925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:20.916408 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:20.917138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:20.917593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:20.918090 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:20.931638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 HTTP/1.1 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:32:20.933316 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:20.935047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '6a77c2c3-1d37-405e-9f1a-536277e8f213'} Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:20.936188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:20.937889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:20.939350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:20.939350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-fafedbdd-1bfc-49a3-bf81-9cee243a400f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 404 len: 111 microversion: 2.1 time: 0.032803 Aug 29 19:32:20.939350 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 547/1098] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:20 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:20.944241 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-adcb5d66-ff90-4e6b-86c4-9f6cd5ec34fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '.version_select at 0x7f1fe1db5d30>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:21.037362 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-adcb5d66-ff90-4e6b-86c4-9f6cd5ec34fc tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326389638" status: 202 len: 0 microversion: 2.1 time: 0.096932 Aug 29 19:32:21.037945 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 552/1099] 10.222.0.62 () {58 vars in 1221 bytes} [Mon Aug 29 19:32:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1326389638 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:32:23.268379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:23.268889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:23.275342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:23.275828 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:23.276311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:23.277007 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:23.277464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:23.277892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:23.292243 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 HTTP/1.1 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:32:23.293811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.295258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '6a77c2c3-1d37-405e-9f1a-536277e8f213'} Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:23.296087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.297543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.298813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:23.298813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-80070435-e08b-42d7-affc-bac942416944 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 404 len: 111 microversion: 2.1 time: 0.030772 Aug 29 19:32:23.298813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 548/1100] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:32:23 2022] DELETE /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:23.305767 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:23.306380 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 6a77c2c3-1d37-405e-9f1a-536277e8f213] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:23.312920 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:23.313411 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:23.313852 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:23.314563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:23.315020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:23.315449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:23.328597 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 HTTP/1.1 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:32:23.330216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.331800 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '6a77c2c3-1d37-405e-9f1a-536277e8f213'} Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:23.332752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. Aug 29 19:32:23.334312 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:23.335713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance 6a77c2c3-1d37-405e-9f1a-536277e8f213 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:23.335713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-67e391c0-c241-4258-8adb-3868afdd5eaa tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213" status: 404 len: 111 microversion: 2.1 time: 0.030837 Aug 29 19:32:23.335713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 553/1101] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:23 2022] GET /compute/v2.1/servers/6a77c2c3-1d37-405e-9f1a-536277e8f213 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:24.610269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:24.610780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:24.618039 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.618529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.618962 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.619741 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.620144 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.620578 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.634573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 HTTP/1.1 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:32:24.636155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.637829 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'ec013e7d-3d9a-4441-bf85-56c8dfc5bca6'} Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:24.638994 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.640869 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.642663 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:24.642663 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-01ee92ff-bdfc-43c3-a9a0-8d2dffcc2ad7 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 404 len: 111 microversion: 2.1 time: 0.031337 Aug 29 19:32:24.642663 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 549/1102] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:32:24 2022] DELETE /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:24.646823 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:24.647497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: ec013e7d-3d9a-4441-bf85-56c8dfc5bca6] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:24.654993 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.655479 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.655955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.656736 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.657218 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.657677 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.673249 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 HTTP/1.1 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:32:24.674758 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.676326 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'ec013e7d-3d9a-4441-bf85-56c8dfc5bca6'} Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:24.677111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. Aug 29 19:32:24.678445 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.679604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:24.679604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5416939b-19db-4732-895e-599d61d11a9d tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6" status: 404 len: 111 microversion: 2.1 time: 0.033468 Aug 29 19:32:24.679604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 554/1103] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:24 2022] GET /compute/v2.1/servers/ec013e7d-3d9a-4441-bf85-56c8dfc5bca6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:24.684967 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:24.685468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:24.691484 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.692001 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.692435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.693127 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.693577 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.694003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.707837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 HTTP/1.1 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:32:24.709390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.711580 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'e452a2db-01eb-42e3-8d8a-cc88d0cea0e1'} Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:24.712624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.714298 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.715818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:24.715818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-ca9fcb53-f7b9-48fa-a43f-9d17d07a06b2 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 404 len: 111 microversion: 2.1 time: 0.029659 Aug 29 19:32:24.715818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 550/1104] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:32:24 2022] DELETE /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:32:24.720207 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:24.720873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: e452a2db-01eb-42e3-8d8a-cc88d0cea0e1] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:24.726836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.727291 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.727720 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.728422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:24.728870 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:24.729293 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:24.743024 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 HTTP/1.1 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:32:24.744545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.746310 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'e452a2db-01eb-42e3-8d8a-cc88d0cea0e1'} Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:24.747252 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. Aug 29 19:32:24.748785 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:24.750447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:24.750447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-25f74503-623b-47e3-8c3f-857b23793d28 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1" status: 404 len: 111 microversion: 2.1 time: 0.029879 Aug 29 19:32:24.750447 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 555/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:24 2022] GET /compute/v2.1/servers/e452a2db-01eb-42e3-8d8a-cc88d0cea0e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:26.102500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:26.102993 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:26.109504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:26.109890 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:26.110317 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:26.111003 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:26.111452 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:26.111888 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:26.126206 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 HTTP/1.1 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:32:26.127755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.129429 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': '8b272a17-8d0c-46ec-a9c7-3399b2785ce7'} Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:26.131473 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.133351 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.134893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:26.134893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9414e148-63c3-4a8d-97c5-9e8fed28a508 tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 404 len: 111 microversion: 2.1 time: 0.031068 Aug 29 19:32:26.134893 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 551/1106] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:32:26 2022] DELETE /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:26.137522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:32:26.146245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] [instance: 8b272a17-8d0c-46ec-a9c7-3399b2785ce7] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:32:26.146245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:26.146245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:26.146245 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:26.146642 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:32:26.146642 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:32:26.146955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:32:26.161226 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] HTTP exception thrown: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Request method failure captured: Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 HTTP/1.1 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRLysFp0-bykMh6p_kWyMjAwKMnu1MGUgll8io70UJIcp93025V9HtFR_VhTN4xv3V0jIMGFFW1xWKl7GTz0NpJjm9ac5QwcqJhITiCyYfHVxpoKC5ZcjIY18XEwP5rrFjchPNpMWF7eihOZn3q9BDAAWE7wIy_IyjE1niGZmBGg0l4 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:32:26.162733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68d8a00f546547178af95e8645c928e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68d8a00f546547178af95e8645c928e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68d8a00f546547178af95e8645c928e7"}]}] Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: 68d8a00f546547178af95e8645c928e7 Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1925142792 Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: 9c0c242c0ad048eb8fd35b4671704056 Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-AttachVolumeNegativeTest-1925142792-project Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.164782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '8b272a17-8d0c-46ec-a9c7-3399b2785ce7'} Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:32:26.165722 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. Aug 29 19:32:26.167629 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:32:26.169382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] Returning 404 to user: Instance 8b272a17-8d0c-46ec-a9c7-3399b2785ce7 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:32:26.169382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-129b9338-56a1-48df-9645-4b5f3bd92b3f tempest-AttachVolumeNegativeTest-1925142792 tempest-AttachVolumeNegativeTest-1925142792-project] 10.222.0.62 "GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7" status: 404 len: 111 microversion: 2.1 time: 0.030897 Aug 29 19:32:26.169382 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 556/1107] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:32:26 2022] GET /compute/v2.1/servers/8b272a17-8d0c-46ec-a9c7-3399b2785ce7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:34:36.361183 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bb2d82f-eed0-4270-9031-ddd6aea7ddb1] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 19:34:36.366702 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:36.367557 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:36.368803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:34:36.368803 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Mon Aug 29 19:34:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.62) !!! Aug 29 19:34:36.370070 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:34:36.370189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Mon Aug 29 19:34:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.62) !!! Aug 29 19:34:36.555977 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b9c6df03-5819-4d09-85f7-4000a5609b67 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Action: 'create', calling method: .version_select at 0x7f1fde3cedc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-217659503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6KFBNqqTe334JMQPr1PZyEvri/iw5SKMasBvVKjOBk8Fn1CMcr69C1dxfFt2GluMbrnLzNl7e6CuNShtQg9496Pi6o+9UjBX5uEiaW2snk4jdvUNzi/6I1NvcC6yaAnQ=="}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:34:36.573423 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-b9c6df03-5819-4d09-85f7-4000a5609b67 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:34:36.577512 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-b9c6df03-5819-4d09-85f7-4000a5609b67 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for user a504697c696e4d8392adf0ae8adf98a7 and project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'key_pairs'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:34:36.687618 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b9c6df03-5819-4d09-85f7-4000a5609b67 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.328372 Aug 29 19:34:36.688245 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 552/1108] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Aug 29 19:34:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:34:57.525120 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11dfbe0f-7671-40cf-aa64-a74620cd8a10] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 19:34:57.526003 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:57.526652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:57.527833 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 19:34:57.528000 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Mon Aug 29 19:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 19:34:57.529987 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 19:34:57.530196 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Mon Aug 29 19:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 19:34:57.537821 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-40334659", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-217659503", "security_groups": [{"name": "tempest-secgroup-smoke-1768465503"}], "block_device_mapping_v2": [{"uuid": "e0be9a25-a41d-490c-bb10-097ffad3c9b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "822d4831-5115-43bb-bce6-c2b8167b8be6"}]}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:34:57.656916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] validate_networks() for [('822d4831-5115-43bb-bce6-c2b8167b8be6', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:34:58.438281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:34:58.438703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:34:58.439223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:34:58.439632 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:34:58.440109 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:34:58.449910 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:34:58.450395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:34:58.450834 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:34:58.451608 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:34:58.452177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:34:58.452610 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:34:58.471738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:34:58.476022 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for user a504697c696e4d8392adf0ae8adf98a7 and project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:34:58.535529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] [11dfbe0f-7671-40cf-aa64-a74620cd8a10] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 36078. Aug 29 19:34:58.546551 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:34:58.548936 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0be9a25-a41d-490c-bb10-097ffad3c9b4',volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:34:59.467061 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7794e26a-c42b-4f9b-b948-913cf85376a5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.943764 Aug 29 19:34:59.467711 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 557/1109] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:34:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:34:59.476252 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:59.477344 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:59.482758 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-329bc9c0-d4d7-4078-b528-b01a4f0e73e7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:34:59.483631 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-329bc9c0-d4d7-4078-b528-b01a4f0e73e7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:34:59.494551 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bb2d82f-eed0-4270-9031-ddd6aea7ddb1] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 36086. Aug 29 19:34:59.542118 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-329bc9c0-d4d7-4078-b528-b01a4f0e73e7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:34:59.549167 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-329bc9c0-d4d7-4078-b528-b01a4f0e73e7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1092 microversion: 2.1 time: 0.074347 Aug 29 19:34:59.549727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 553/1110] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:34:59 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:00.570261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0e5ad612-1925-4778-affc-16d41248328d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:00.570856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0e5ad612-1925-4778-affc-16d41248328d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:00.628563 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0e5ad612-1925-4778-affc-16d41248328d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:00.634378 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0e5ad612-1925-4778-affc-16d41248328d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1092 microversion: 2.1 time: 0.068349 Aug 29 19:35:00.634982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 558/1111] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:00 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:01.656908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4725efea-3bca-4b9e-97b5-ad799a946b3f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:01.657545 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4725efea-3bca-4b9e-97b5-ad799a946b3f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:01.718572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4725efea-3bca-4b9e-97b5-ad799a946b3f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:01.725789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4725efea-3bca-4b9e-97b5-ad799a946b3f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1092 microversion: 2.1 time: 0.073262 Aug 29 19:35:01.726363 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 554/1112] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:01 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1092 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:02.747395 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ae910637-694e-4da1-9a00-4456acf0a872 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:02.748027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ae910637-694e-4da1-9a00-4456acf0a872 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:02.804056 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ae910637-694e-4da1-9a00-4456acf0a872 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:02.811813 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ae910637-694e-4da1-9a00-4456acf0a872 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1092 microversion: 2.1 time: 0.068428 Aug 29 19:35:02.812410 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 559/1113] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:02 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:03.835468 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c6817b21-bf75-417f-9381-c7afbb55cfc8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:03.836357 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c6817b21-bf75-417f-9381-c7afbb55cfc8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:03.898463 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c6817b21-bf75-417f-9381-c7afbb55cfc8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:03.906301 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c6817b21-bf75-417f-9381-c7afbb55cfc8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1092 microversion: 2.1 time: 0.077092 Aug 29 19:35:03.910294 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 555/1114] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:03 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1092 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:04.929663 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:04.930266 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:04.937234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:04.937719 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:04.938173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:04.938967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:04.939482 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:04.939999 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:05.024928 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:05.033158 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b13413f1-cfc8-47b8-bcb7-836c6a4d1e40 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1142 microversion: 2.1 time: 0.109153 Aug 29 19:35:05.033732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 560/1115] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:04 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1142 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:06.054726 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:06.055552 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:06.062908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:06.065368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:06.065368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:06.065368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:06.065368 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:06.065956 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:06.133337 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:06.142185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c98c6d5b-7950-4d2a-9a0f-fdb6d3a8a914 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1142 microversion: 2.1 time: 0.091743 Aug 29 19:35:06.142901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 556/1116] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:06 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1142 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:07.164865 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:07.165502 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:07.172234 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:07.172708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:07.173142 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:07.173838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:07.174290 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:07.174715 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:07.250652 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:07.264313 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-baf9212a-5794-4363-80e8-896076eac522 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1190 microversion: 2.1 time: 0.103639 Aug 29 19:35:07.271916 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 561/1117] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:07 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1190 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:08.287804 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:08.288454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:08.295949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:08.296441 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:08.297678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:08.297678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:08.298287 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:08.298733 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:08.368491 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:08.378628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-60e2a2e6-d9f1-4470-969d-cf557db94e2e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1198 microversion: 2.1 time: 0.094708 Aug 29 19:35:08.378628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 557/1118] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:08 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:09.400911 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:09.401784 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:09.404258 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:09.409546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:09.410118 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:09.410673 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:09.412491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:09.412638 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:09.413057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:09.566148 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:09.575066 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a9d52325-d25c-413a-bed9-d459c609e7bf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1276 microversion: 2.1 time: 0.178504 Aug 29 19:35:09.575696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 562/1119] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:09 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:10.410440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-988ee9b1-0a25-473f-bbe3-bb83082c2a69 req-1dc37533-6737-4b36-a791-b1724631c12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4881f7f-3ff5-4baa-aec0-a1ab437eea32", "tag": "b4551082-7c96-413e-8c13-0254420138ab"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:35:10.423686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-988ee9b1-0a25-473f-bbe3-bb83082c2a69 req-1dc37533-6737-4b36-a791-b1724631c12f service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:10.424279 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-988ee9b1-0a25-473f-bbe3-bb83082c2a69 req-1dc37533-6737-4b36-a791-b1724631c12f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:10.424713 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-988ee9b1-0a25-473f-bbe3-bb83082c2a69 req-1dc37533-6737-4b36-a791-b1724631c12f service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:10.437693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-988ee9b1-0a25-473f-bbe3-bb83082c2a69 req-1dc37533-6737-4b36-a791-b1724631c12f service nova] Creating event network-changed:b4551082-7c96-413e-8c13-0254420138ab for instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 on hv-cinder-85501 Aug 29 19:35:10.443199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-988ee9b1-0a25-473f-bbe3-bb83082c2a69 req-1dc37533-6737-4b36-a791-b1724631c12f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036747 Aug 29 19:35:10.444046 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 558/1120] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:35:10.596648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:10.597472 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:10.605922 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:10.606407 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:10.606838 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:10.607545 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:10.608217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:10.608639 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:10.759782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:10.768134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-e5cdfb56-9f1c-47ed-a20d-dc4a190e1044 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1276 microversion: 2.1 time: 0.175504 Aug 29 19:35:10.768723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 563/1121] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:10 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:11.791338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:11.792119 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:11.799281 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:11.799763 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:11.800216 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:11.800982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:11.801369 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:11.801781 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:11.949881 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:11.959489 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-84781eab-e8c8-4fe6-bb13-0840f2c937e5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.172312 Aug 29 19:35:11.960328 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 559/1122] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:11 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:35:12.980363 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:12.980995 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:12.983437 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=10 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:12.988540 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:12.989522 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:12.989991 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:12.990980 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:12.991465 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:12.991932 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:13.144628 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:13.153309 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c43c2615-916c-40ff-9f57-47f7464747e8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.176790 Aug 29 19:35:13.153992 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 564/1123] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:12 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:14.174068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:14.174686 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:14.177121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:14.182318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:14.182812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:14.183254 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:14.183996 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:14.184455 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:14.184877 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:14.327544 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:14.336542 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-644bb8bf-4697-46cc-92bb-1cd433249353 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.166215 Aug 29 19:35:14.337121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 560/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:14 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:15.357304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:15.357935 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:15.365256 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:15.365998 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:15.366434 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:15.367208 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:15.367778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:15.368177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:15.551063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:15.560491 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3cb0709d-1a15-4775-a80a-62bea54fc218 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.207425 Aug 29 19:35:15.561088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 565/1125] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:15 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:16.581198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:16.581947 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:16.589342 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:16.589820 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:16.590259 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:16.592864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:16.592864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:16.592864 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:16.740196 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:16.748875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-90e41532-6bcd-443a-827d-2a7a9c184153 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.171564 Aug 29 19:35:16.749456 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 561/1126] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:16 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:17.770762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:17.771389 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:17.778592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:17.779068 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:17.779497 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:17.780244 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:17.780698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:17.781105 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:17.933471 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:17.941962 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c80a7d30-1779-4727-b211-abb68fa579b0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.174962 Aug 29 19:35:17.942561 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 566/1127] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:17 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:18.963529 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:18.964189 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:18.970683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:18.971192 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:18.971593 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:18.972325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:18.972773 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:18.973826 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:19.134303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:19.142137 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-732c6b89-f324-423c-b045-8c9ddb9e0a15 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.182633 Aug 29 19:35:19.142704 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 562/1128] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:18 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:20.163634 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:20.164412 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:20.171035 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:20.171525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:20.171991 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:20.172700 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:20.173168 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:20.173588 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:20.309732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:20.318141 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-a99562ec-3bc5-4166-ac33-941e190833d9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.158433 Aug 29 19:35:20.319054 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 567/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:20 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:21.339500 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:21.340309 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:21.347087 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:21.348142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:21.348142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:21.348858 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:21.349420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:21.349847 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:21.508486 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:21.514925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-85f43988-a3eb-4fd7-bb93-2a8c73a29c2a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.179462 Aug 29 19:35:21.515768 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 563/1130] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:21 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:35:22.537237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:22.537872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:22.545032 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:22.545512 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:22.545948 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:22.546656 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:22.547114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:22.547114 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:22.689095 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:22.699099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3de09c61-ed9f-463b-94b8-bd193a8a1983 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.166379 Aug 29 19:35:22.699698 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 568/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:22 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:23.108889 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-eaba264a-e66c-4bb2-9979-a9857621b2fb req-e7aff7c9-385f-483c-bd99-e940d63ee88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4881f7f-3ff5-4baa-aec0-a1ab437eea32", "name": "network-vif-plugged", "status": "completed", "tag": "b4551082-7c96-413e-8c13-0254420138ab"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:35:23.118909 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-eaba264a-e66c-4bb2-9979-a9857621b2fb req-e7aff7c9-385f-483c-bd99-e940d63ee88e service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:23.120361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-eaba264a-e66c-4bb2-9979-a9857621b2fb req-e7aff7c9-385f-483c-bd99-e940d63ee88e service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:23.120361 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-eaba264a-e66c-4bb2-9979-a9857621b2fb req-e7aff7c9-385f-483c-bd99-e940d63ee88e service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:23.134718 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-eaba264a-e66c-4bb2-9979-a9857621b2fb req-e7aff7c9-385f-483c-bd99-e940d63ee88e service nova] Creating event network-vif-plugged:b4551082-7c96-413e-8c13-0254420138ab for instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 on hv-cinder-85501 Aug 29 19:35:23.140206 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-eaba264a-e66c-4bb2-9979-a9857621b2fb req-e7aff7c9-385f-483c-bd99-e940d63ee88e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094988 Aug 29 19:35:23.140837 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 564/1132] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:35:23.721276 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:23.721882 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:23.730559 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:23.736164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:23.736164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:23.736164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:23.736164 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:23.736546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:23.883552 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:23.891902 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c9724339-354b-409b-a93d-a4833339f9fd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.174478 Aug 29 19:35:23.892478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 569/1133] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:23 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:24.914647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:24.915352 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:24.922757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:24.923556 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:24.924308 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:24.925454 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:24.926723 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:24.927390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:25.092068 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:25.102497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-401c1c62-4072-4329-85fc-a7d9d1f5878f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1264 microversion: 2.1 time: 0.192727 Aug 29 19:35:25.103084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 565/1134] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:24 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:26.138933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:26.138933 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:26.141667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:26.142174 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:26.142604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:26.143304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:26.143757 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:26.144207 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:26.286031 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:26.294189 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-963d0c84-091c-432f-a281-e33dcbe88c61 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1451 microversion: 2.1 time: 0.164123 Aug 29 19:35:26.294769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 570/1135] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:26 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:26.314703 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:35:26.315318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:35:26.322610 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:26.324509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:26.324509 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:26.324752 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:26.325076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:26.325504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:26.477660 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:35:26.486501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-abd0b0d0-bb0f-41da-9b2f-92d0498d831c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1451 microversion: 2.1 time: 0.175708 Aug 29 19:35:26.487251 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 566/1136] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:35:26 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:35:29.016678 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4881f7f-3ff5-4baa-aec0-a1ab437eea32", "tag": "b4551082-7c96-413e-8c13-0254420138ab"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:35:29.022046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:29.027685 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:35:29.028204 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:35:29.028661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:35:29.033171 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=69 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:29.043661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] Creating event network-changed:b4551082-7c96-413e-8c13-0254420138ab for instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 on hv-cinder-85501 Aug 29 19:35:29.047537 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR oslo.messaging._drivers.impl_rabbit [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] [14fa6951-1aa7-4bb7-9eb6-7188c12511d1] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 19:35:30.056604 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] [14fa6951-1aa7-4bb7-9eb6-7188c12511d1] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 36172. Aug 29 19:35:30.060773 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-73ce4014-de6c-466f-be11-0e11fa5a769a req-61184188-0fd0-4716-aefb-d5f9bef6e75c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.124579 Aug 29 19:35:30.061759 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 571/1137] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:37:24.161190 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=34 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:24.161954 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=58 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:24.167972 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:24.168564 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:24.174778 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:24.176358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:24.176358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:24.176572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:24.176965 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:24.177394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:24.204023 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:37:24.522786 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a0767963-f345-4b47-83bd-9be5d958fdaf tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 204 len: 0 microversion: 2.1 time: 0.363402 Aug 29 19:37:24.523371 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 567/1138] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:37:24 2022] DELETE /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:37:24.530896 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:24.531702 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=1 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:24.536954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:24.537660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:24.544209 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:24.544695 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:24.545131 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:24.545853 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:24.546306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:24.546733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:24.795422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:24.803349 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-824c176f-e17f-4902-934c-03f72b77df7f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1576 microversion: 2.1 time: 0.274726 Aug 29 19:37:24.803959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 572/1139] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:24 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:37:25.825900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:25.826608 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:25.833624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:25.834117 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:25.834558 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:25.835263 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:25.835907 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:25.836340 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:26.054253 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:26.062640 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-33263311-e76c-45ab-9d4f-e123fb1ce0b2 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1576 microversion: 2.1 time: 0.241413 Aug 29 19:37:26.063214 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 568/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:25 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:27.084431 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:27.085047 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:27.099978 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:27.100762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:27.101501 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:27.102667 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:27.103450 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:27.104214 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:27.186135 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:27.195045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-0b3e163e-8f46-4604-879a-5b5ca487e7b9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1508 microversion: 2.1 time: 0.114650 Aug 29 19:37:27.195930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 573/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:27 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1508 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:27.460104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-e3259a93-6561-4d20-b6ce-f0371e06598a req-a32717fe-d3ac-42f2-b1eb-51968ccbd316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4881f7f-3ff5-4baa-aec0-a1ab437eea32", "name": "network-vif-deleted", "tag": "b4551082-7c96-413e-8c13-0254420138ab"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:37:27.470084 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e3259a93-6561-4d20-b6ce-f0371e06598a req-a32717fe-d3ac-42f2-b1eb-51968ccbd316 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:27.470739 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e3259a93-6561-4d20-b6ce-f0371e06598a req-a32717fe-d3ac-42f2-b1eb-51968ccbd316 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:27.471832 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-e3259a93-6561-4d20-b6ce-f0371e06598a req-a32717fe-d3ac-42f2-b1eb-51968ccbd316 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:27.486812 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-e3259a93-6561-4d20-b6ce-f0371e06598a req-a32717fe-d3ac-42f2-b1eb-51968ccbd316 service nova] Creating event network-vif-deleted:b4551082-7c96-413e-8c13-0254420138ab for instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 on hv-cinder-85501 Aug 29 19:37:27.492178 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-e3259a93-6561-4d20-b6ce-f0371e06598a req-a32717fe-d3ac-42f2-b1eb-51968ccbd316 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097343 Aug 29 19:37:27.496668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 569/1142] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:37:28.220961 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:28.221579 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:28.229900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:28.230413 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:28.230831 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:28.231549 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:28.232036 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:28.232478 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:28.305703 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:28.315640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5b46b11c-d5d5-40b0-93de-070b7b06805d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 200 len: 1223 microversion: 2.1 time: 0.098791 Aug 29 19:37:28.316972 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 574/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:28 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:29.339597 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:29.340318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:29.346607 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:29.347121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:29.348872 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:29.348872 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:29.349401 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:29.349868 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:29.363926 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] HTTP exception thrown: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Request method failure captured: Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 HTTP/1.1 Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRTFOZPj7yKmKtITRG_BVuAO9eRURfJ38vUlVQ_eFFoQwmOZwTFjR7GbjMnGVOnmpac3CGz3y7TSVaBbenaeH79PHtOMtHErGRWciV_mR3CHhX7gsfMiX-2m62A4rMJD1emDPMryLY-uiK3Y_4KObPoCGC8GMbFxkgl_PV9ali362To Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:37:29.365573 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f253ee21c29a44b4bfee93f14c26a2d5"}]}] Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: a504697c696e4d8392adf0ae8adf98a7 Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:37:29.368818 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'e4881f7f-3ff5-4baa-aec0-a1ab437eea32'} Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:37:29.370840 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:37:29.373920 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:37:29.377193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Returning 404 to user: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:37:29.377193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2a886f5b-9bda-4910-bf0e-fd93d1e8f749 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 404 len: 111 microversion: 2.1 time: 0.032914 Aug 29 19:37:29.377193 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 570/1144] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:29 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:37:29.422052 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2146714198", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-217659503", "security_groups": [{"name": "tempest-secgroup-smoke-1768465503"}], "block_device_mapping_v2": [{"uuid": "e0be9a25-a41d-490c-bb10-097ffad3c9b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "822d4831-5115-43bb-bce6-c2b8167b8be6"}]}} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:37:29.537732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.network.neutron [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] validate_networks() for [('822d4831-5115-43bb-bce6-c2b8167b8be6', None, None, None, None, None)] {{(pid=121337) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:37:29.914295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Flavor limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:37:29.914713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Image limits 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:37:29.915240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Flavor pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:37:29.915648 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Image pref 0:0:0 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:37:29.916101 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.virt.hardware [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:37:29.925571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:29.931836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:29.931836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:29.931836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:29.931836 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:29.932261 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:29.944723 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:37:29.948954 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.quota [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for user a504697c696e4d8392adf0ae8adf98a7 and project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=121337) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:37:30.008107 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Going to run 1 instances... {{(pid=121337) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:37:30.012046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0be9a25-a41d-490c-bb10-097ffad3c9b4',volume_size=None,volume_type=None)] {{(pid=121337) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:37:30.450560 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-61a658a7-c0d3-4790-92df-4a9589c43307 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.033094 Aug 29 19:37:30.451251 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 575/1145] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:37:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:37:30.462425 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-4d7be812-dcf5-4ad1-b7ba-156859314ef5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:30.464586 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-4d7be812-dcf5-4ad1-b7ba-156859314ef5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:30.518098 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-4d7be812-dcf5-4ad1-b7ba-156859314ef5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:30.525409 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-4d7be812-dcf5-4ad1-b7ba-156859314ef5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1094 microversion: 2.1 time: 0.066993 Aug 29 19:37:30.525995 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 571/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:30 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:31.547580 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f0d3b15a-5c11-4060-8241-199912cb90d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:31.548219 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f0d3b15a-5c11-4060-8241-199912cb90d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:31.604454 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f0d3b15a-5c11-4060-8241-199912cb90d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:31.611981 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f0d3b15a-5c11-4060-8241-199912cb90d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1094 microversion: 2.1 time: 0.070089 Aug 29 19:37:31.612480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 576/1147] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:31 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:32.631697 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-89849da8-18b8-427c-b2ba-183b72fdce05 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:32.632341 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-89849da8-18b8-427c-b2ba-183b72fdce05 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:32.687947 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-89849da8-18b8-427c-b2ba-183b72fdce05 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:32.694982 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-89849da8-18b8-427c-b2ba-183b72fdce05 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1094 microversion: 2.1 time: 0.067093 Aug 29 19:37:32.695568 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 572/1148] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:32 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:33.715690 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4d3f7759-1824-4172-8b01-1c8a60cc48fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:33.716352 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4d3f7759-1824-4172-8b01-1c8a60cc48fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:33.773714 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4d3f7759-1824-4172-8b01-1c8a60cc48fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:33.780757 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4d3f7759-1824-4172-8b01-1c8a60cc48fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1094 microversion: 2.1 time: 0.069120 Aug 29 19:37:33.781319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 577/1149] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:33 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:34.801757 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:34.802491 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:34.809146 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:34.809635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:34.810071 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:34.810853 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:34.811338 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:34.811770 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:34.891647 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:34.899921 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-c29f5543-4d71-4afc-ba74-ed86fa6c3fe8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1144 microversion: 2.1 time: 0.102107 Aug 29 19:37:34.900796 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 573/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:34 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:35.922289 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:35.922929 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:35.929546 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:35.930034 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:35.930753 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:35.931242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:35.931701 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:35.932669 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:35.997893 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:36.005751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5bc34dd3-ef5a-4f5a-b292-cddec52e03fa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1144 microversion: 2.1 time: 0.087471 Aug 29 19:37:36.006342 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 578/1151] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:35 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:37.026875 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:37.027569 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:37.034126 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:37.034600 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:37.035028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:37.035711 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:37.036195 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:37.036609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:37.099302 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:37.107621 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-bc27f1d0-6e5b-4ca5-8e6f-622750470e8a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1192 microversion: 2.1 time: 0.084657 Aug 29 19:37:37.111779 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 574/1152] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:37 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:38.129636 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:38.130756 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:38.138161 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:38.138647 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:38.139081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:38.139783 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:38.140265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:38.140689 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:38.286306 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:38.297235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b1f8c224-de8c-411d-ad09-e0e21ab07d6e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1278 microversion: 2.1 time: 0.170331 Aug 29 19:37:38.297470 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 579/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:38 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:39.116057 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-c0b065f8-543c-480f-b1cb-46196761fe13 req-ad08d57b-408a-4403-921c-7e1dc739e128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2198896-a469-4d0e-b382-c97b1998f447", "tag": "029cad2e-8180-43aa-afc6-5d8cf11a9ebd"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:37:39.131390 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c0b065f8-543c-480f-b1cb-46196761fe13 req-ad08d57b-408a-4403-921c-7e1dc739e128 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:39.132790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c0b065f8-543c-480f-b1cb-46196761fe13 req-ad08d57b-408a-4403-921c-7e1dc739e128 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:39.132790 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-c0b065f8-543c-480f-b1cb-46196761fe13 req-ad08d57b-408a-4403-921c-7e1dc739e128 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:39.145937 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-c0b065f8-543c-480f-b1cb-46196761fe13 req-ad08d57b-408a-4403-921c-7e1dc739e128 service nova] Creating event network-changed:029cad2e-8180-43aa-afc6-5d8cf11a9ebd for instance e2198896-a469-4d0e-b382-c97b1998f447 on hv-cinder-85501 Aug 29 19:37:39.151215 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-c0b065f8-543c-480f-b1cb-46196761fe13 req-ad08d57b-408a-4403-921c-7e1dc739e128 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038855 Aug 29 19:37:39.152219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 575/1154] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:37:39.318151 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:39.318900 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:39.326187 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:39.326661 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:39.327088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:39.327782 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:39.328288 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:39.328708 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:39.477388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:39.488448 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-36a50792-1f41-4a86-8a54-b25a61026faa tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.174068 Aug 29 19:37:39.489024 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 580/1155] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:39 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:40.511830 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:40.512543 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:40.519274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:40.519767 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:40.520224 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:40.520913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:40.521358 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:40.521772 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:40.656815 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:40.664497 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-15f9eca1-5378-40b3-a69c-3f5b76639234 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.157523 Aug 29 19:37:40.665058 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 576/1156] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:40 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:41.686370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:41.687020 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:41.688914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:41.694137 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:41.694742 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:41.695175 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:41.695878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:41.696343 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:41.698436 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:41.835250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:41.875005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-45bcea52-7ec5-4306-95d6-736aa14125d0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.161606 Aug 29 19:37:41.875005 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 581/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:41 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:42.866028 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:42.866854 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:42.869435 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=4 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:42.875078 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:42.875553 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:42.876014 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:42.876696 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:42.877142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:42.877606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:43.012785 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:43.020624 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-b62090c2-8a33-4c0c-9419-4d0df51355e1 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.158824 Aug 29 19:37:43.024874 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 577/1158] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:42 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:44.040941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:44.041535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:44.044620 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=10 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:44.049592 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:44.050074 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:44.050645 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:44.051370 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:44.051888 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:44.052337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:44.197420 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:44.205795 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2bdff52e-c70c-4b4d-8134-0d8bcaea4be0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.168654 Aug 29 19:37:44.206419 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 582/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:44 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:45.232656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:45.232656 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:45.234075 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:45.234380 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:45.234813 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:45.235940 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:45.236289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:45.236289 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:45.373393 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:45.381258 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-e58d0ad0-a797-46ef-a354-30cd2df36245 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.158492 Aug 29 19:37:45.381828 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 578/1160] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:45 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:46.403250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:46.403898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:46.410796 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:46.411272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:46.411706 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:46.412427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:46.412878 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:46.413297 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:46.546213 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:46.554353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4aa49c49-97b4-41c9-8020-e454a0d9f9af tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.155027 Aug 29 19:37:46.554914 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 583/1161] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:46 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:47.574809 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:47.575440 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:47.582264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:47.582760 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:47.583198 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:47.583953 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:47.584419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:47.584842 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:47.720494 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:47.728162 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a5f2f105-81a9-4cea-a630-4bd9dbc49f70 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.157324 Aug 29 19:37:47.731006 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 579/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:47 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:48.749498 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:48.750156 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:48.756658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:48.757129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:48.757558 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:48.758238 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:48.758683 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:48.759102 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:48.887791 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:48.895781 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-fd7a8ba8-98d9-4502-a1e8-ea6637a719e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.150167 Aug 29 19:37:48.896393 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 584/1163] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:48 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:37:49.772774 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-4dcf71ac-1494-4da9-bcfc-a10519eb5122 req-e6c88023-0920-4619-8442-22f300c8b8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2198896-a469-4d0e-b382-c97b1998f447", "name": "network-vif-plugged", "status": "completed", "tag": "029cad2e-8180-43aa-afc6-5d8cf11a9ebd"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:37:49.783170 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-4dcf71ac-1494-4da9-bcfc-a10519eb5122 req-e6c88023-0920-4619-8442-22f300c8b8e5 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:49.783652 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-4dcf71ac-1494-4da9-bcfc-a10519eb5122 req-e6c88023-0920-4619-8442-22f300c8b8e5 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:49.784113 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-4dcf71ac-1494-4da9-bcfc-a10519eb5122 req-e6c88023-0920-4619-8442-22f300c8b8e5 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:49.797237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-4dcf71ac-1494-4da9-bcfc-a10519eb5122 req-e6c88023-0920-4619-8442-22f300c8b8e5 service nova] Creating event network-vif-plugged:029cad2e-8180-43aa-afc6-5d8cf11a9ebd for instance e2198896-a469-4d0e-b382-c97b1998f447 on hv-cinder-85501 Aug 29 19:37:49.805290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-4dcf71ac-1494-4da9-bcfc-a10519eb5122 req-e6c88023-0920-4619-8442-22f300c8b8e5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Aug 29 19:37:49.805290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 580/1164] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:37:49.917581 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:49.931201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:49.931201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:49.931201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:49.931201 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:49.932277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:49.932277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:49.932277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:50.064320 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:50.072955 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-17c9f1cb-9313-4828-9c51-f043518c6882 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.159174 Aug 29 19:37:50.079013 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 585/1165] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:49 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:51.096993 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:51.097688 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:51.103934 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:51.104418 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:51.104851 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:51.105547 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:51.105998 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:51.106419 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:51.246861 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:51.259679 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-5af5dd03-4956-4fd3-8613-8153cdb802f4 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1266 microversion: 2.1 time: 0.167811 Aug 29 19:37:51.260365 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 581/1166] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:51 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:52.281584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:52.282179 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:52.288941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:52.289424 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:52.289866 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:52.290585 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:52.291040 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:52.291467 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:52.428231 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:52.433566 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-bf55f37a-2f0f-4a3d-94c1-4ab678a73003 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1454 microversion: 2.1 time: 0.156022 Aug 29 19:37:52.434134 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 586/1167] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:52 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:52.454354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:37:52.454998 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:37:52.461488 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:52.461974 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:52.462402 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:52.463093 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:52.463546 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:52.464505 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:52.597314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:37:52.605819 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-0d25841a-b8fc-446e-8ec3-61fdb8e618bb tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1454 microversion: 2.1 time: 0.155308 Aug 29 19:37:52.606379 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 582/1168] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:37:52 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:37:55.169898 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-4d9bfeec-121e-4417-9e40-3b3ac767b3da req-eae840ea-d3eb-4c6b-b7de-e3a649cd78b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2198896-a469-4d0e-b382-c97b1998f447", "tag": "029cad2e-8180-43aa-afc6-5d8cf11a9ebd"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:37:55.175279 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:55.180913 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-4d9bfeec-121e-4417-9e40-3b3ac767b3da req-eae840ea-d3eb-4c6b-b7de-e3a649cd78b7 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:37:55.181388 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-4d9bfeec-121e-4417-9e40-3b3ac767b3da req-eae840ea-d3eb-4c6b-b7de-e3a649cd78b7 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:37:55.181854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-4d9bfeec-121e-4417-9e40-3b3ac767b3da req-eae840ea-d3eb-4c6b-b7de-e3a649cd78b7 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:37:55.186351 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=75 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:55.194720 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-4d9bfeec-121e-4417-9e40-3b3ac767b3da req-eae840ea-d3eb-4c6b-b7de-e3a649cd78b7 service nova] Creating event network-changed:029cad2e-8180-43aa-afc6-5d8cf11a9ebd for instance e2198896-a469-4d0e-b382-c97b1998f447 on hv-cinder-85501 Aug 29 19:37:55.200319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-4d9bfeec-121e-4417-9e40-3b3ac767b3da req-eae840ea-d3eb-4c6b-b7de-e3a649cd78b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034390 Aug 29 19:37:55.201124 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 587/1169] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:39:56.826199 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:39:56.826981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:39:56.828122 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:39:56.828262 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Mon Aug 29 19:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 19:39:56.829269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:39:56.829394 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Mon Aug 29 19:39:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.62) !!! Aug 29 19:39:56.834391 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-723601235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-217659503", "security_groups": [{"name": "tempest-secgroup-smoke-1768465503"}], "block_device_mapping_v2": [{"uuid": "723bebf7-e58b-4bc9-9d0e-741f735b8d1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "822d4831-5115-43bb-bce6-c2b8167b8be6"}]}} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:39:56.957780 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.network.neutron [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] validate_networks() for [('822d4831-5115-43bb-bce6-c2b8167b8be6', None, None, None, None, None)] {{(pid=121336) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:39:57.429464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Flavor limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:39:57.429891 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Image limits 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:39:57.430436 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Flavor pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:39:57.430846 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Image pref 0:0:0 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:39:57.431260 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.virt.hardware [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121336) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:39:57.440574 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:39:57.441065 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:39:57.441502 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:39:57.442236 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:39:57.442693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:39:57.443121 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:39:57.461137 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:39:57.465901 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.quota [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Getting quotas for user a504697c696e4d8392adf0ae8adf98a7 and project f253ee21c29a44b4bfee93f14c26a2d5. Resources: {'instances', 'ram', 'cores'} {{(pid=121336) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:39:57.526811 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Going to run 1 instances... {{(pid=121336) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:39:57.529120 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='723bebf7-e58b-4bc9-9d0e-741f735b8d1e',volume_size=None,volume_type=None)] {{(pid=121336) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:39:58.185997 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-2853d089-df5a-4f5c-888c-a7f0b06653c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.361764 Aug 29 19:39:58.186981 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 583/1170] 10.222.0.62 () {60 vars in 1147 bytes} [Mon Aug 29 19:39:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:39:58.198106 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11dfbe0f-7671-40cf-aa64-a74620cd8a10] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 19:39:58.199172 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:39:58.199333 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Mon Aug 29 19:39:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 (ip 10.222.0.62) !!! Aug 29 19:39:58.201265 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 19:39:58.201416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Mon Aug 29 19:39:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 (ip 10.222.0.62) !!! Aug 29 19:39:58.208002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-f413c586-ff43-4267-baa3-21e07bd1e15d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:39:58.208717 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-f413c586-ff43-4267-baa3-21e07bd1e15d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:39:58.271752 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-f413c586-ff43-4267-baa3-21e07bd1e15d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:39:58.279345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-f413c586-ff43-4267-baa3-21e07bd1e15d tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1093 microversion: 2.1 time: 0.085543 Aug 29 19:39:58.280235 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 588/1171] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:39:58 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:39:59.300377 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:39:59.301067 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:39:59.308513 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:39:59.309029 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:39:59.309464 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:39:59.310160 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:39:59.310667 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:39:59.311088 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:39:59.372499 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:39:59.380153 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-300ba6a1-61dd-44c3-800c-1587b1bac29c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1143 microversion: 2.1 time: 0.083928 Aug 29 19:39:59.380715 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 584/1172] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:39:59 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:00.401282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:00.401854 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:00.410221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:00.410733 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:00.411167 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:00.411871 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:00.412329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:00.412751 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:00.418776 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO oslo.messaging._drivers.impl_rabbit [-] [11dfbe0f-7671-40cf-aa64-a74620cd8a10] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 36410. Aug 29 19:40:00.482906 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:00.490976 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-5d25fe64-9627-4aff-af93-e97e553b03f9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1191 microversion: 2.1 time: 0.093698 Aug 29 19:40:00.491548 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 589/1173] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:00 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:40:01.512617 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:01.513142 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:01.519102 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:01.519581 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:01.520047 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:01.520727 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:01.521175 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:01.521592 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:01.587983 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:01.596799 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6eee22e0-a867-472c-89a6-bc5956fc358c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1209 microversion: 2.1 time: 0.088385 Aug 29 19:40:01.597362 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 585/1174] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:01 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:02.647709 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:02.648353 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:02.655530 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:02.656049 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:02.656480 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:02.657182 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:02.657628 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:02.658045 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:02.795417 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-b4bb42a2-4a93-42dd-b810-0ac66e573777 req-67ed21c7-6867-44cf-be51-80c1a5bd59ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8", "tag": "b303352a-e74d-4248-bcda-cb4ae2df57bf"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:40:02.795982 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:02.806240 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b9aba71f-15cf-4f88-84d7-830a7fd90d6b tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1277 microversion: 2.1 time: 0.162377 Aug 29 19:40:02.806504 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b4bb42a2-4a93-42dd-b810-0ac66e573777 req-67ed21c7-6867-44cf-be51-80c1a5bd59ac service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:02.807250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 590/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:02 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:02.807410 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b4bb42a2-4a93-42dd-b810-0ac66e573777 req-67ed21c7-6867-44cf-be51-80c1a5bd59ac service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:02.807609 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-b4bb42a2-4a93-42dd-b810-0ac66e573777 req-67ed21c7-6867-44cf-be51-80c1a5bd59ac service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:02.822008 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-b4bb42a2-4a93-42dd-b810-0ac66e573777 req-67ed21c7-6867-44cf-be51-80c1a5bd59ac service nova] Creating event network-changed:b303352a-e74d-4248-bcda-cb4ae2df57bf for instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 on hv-cinder-85501 Aug 29 19:40:02.826290 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-b4bb42a2-4a93-42dd-b810-0ac66e573777 req-67ed21c7-6867-44cf-be51-80c1a5bd59ac service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035044 Aug 29 19:40:02.829807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 586/1176] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:40:03.827757 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:03.828391 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:03.834868 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:03.835341 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:03.835769 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:03.836506 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:03.836949 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:03.837373 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:03.974376 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:03.983295 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-56957cfb-9109-4537-a905-39935a4e07dd tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.159521 Aug 29 19:40:03.983873 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 591/1177] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:03 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:05.005707 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:05.006412 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:05.013518 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:05.014007 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:05.014448 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:05.015154 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:05.015613 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:05.016080 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:05.157721 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:05.170062 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-127e8b30-b718-4925-82a3-27e78ea65261 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.168996 Aug 29 19:40:05.170636 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 587/1178] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:04 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:06.191177 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:06.192099 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:06.198539 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:06.199027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:06.199463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:06.200195 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:06.200658 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:06.201076 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:06.344806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:06.359181 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ce28e3ce-6d78-408a-95fe-dab2ea862f24 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.172135 Aug 29 19:40:06.359763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 592/1179] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:06 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:07.379572 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:07.380240 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:07.387185 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:07.387664 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:07.388134 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:07.388821 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:07.389274 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:07.389693 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:07.451633 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=2 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:40:07.473103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell0:SELECT=6 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:40:07.520112 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:07.527998 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-38f7cec3-20b6-4fa0-b575-ca7a3ba234b8 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.152316 Aug 29 19:40:07.528564 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 588/1180] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:07 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:08.550354 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:08.550979 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:08.553319 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell0:SELECT=2 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:40:08.558250 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:08.558732 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:08.559242 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:08.559959 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:08.560414 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:08.566826 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:08.692402 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:08.698127 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-75e98e90-dd26-428c-9bde-38a7aefe87a3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.151602 Aug 29 19:40:08.698690 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 593/1181] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:08 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:09.718996 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:09.719637 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:09.726296 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:09.728037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:09.728037 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:09.728501 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:09.729044 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:09.729466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:09.865691 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:09.875104 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1662a2d6-81c8-499e-9a01-b2015f3788da tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.160192 Aug 29 19:40:09.875683 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 589/1182] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:09 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:10.895525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:10.896165 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:10.903033 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:10.903513 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:10.903967 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:10.904660 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:10.905111 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:10.905533 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:11.038163 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:11.046609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-b5e61f91-c060-40b3-8f94-0b71331912f0 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.154993 Aug 29 19:40:11.047173 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 594/1183] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:10 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:40:12.066635 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:12.067249 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:12.073873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:12.074354 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:12.074789 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:12.075490 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:12.075973 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:12.076400 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:12.215102 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:12.223218 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-9a8e6807-ea03-41c7-b72b-bc1547400dc5 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.160411 Aug 29 19:40:12.223807 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 590/1184] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:12 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:13.245557 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:13.246371 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:13.252998 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:13.253475 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:13.253904 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:13.254600 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:13.255046 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:13.255463 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:13.394427 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:13.402440 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-182372b9-119a-44ac-89b4-1d0ac381d0c3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.161081 Aug 29 19:40:13.403026 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 595/1185] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:13 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:40:14.423665 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:14.424305 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:14.431931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:14.432428 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:14.432949 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:14.433678 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:14.434138 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:14.434561 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:14.479739 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-e28dcdb2-0bbd-4e0f-af74-3a6a2ecc3e51 req-bd27edfb-da88-4c6c-ade4-2758050d73b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8", "name": "network-vif-plugged", "status": "completed", "tag": "b303352a-e74d-4248-bcda-cb4ae2df57bf"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:40:14.490672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e28dcdb2-0bbd-4e0f-af74-3a6a2ecc3e51 req-bd27edfb-da88-4c6c-ade4-2758050d73b0 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:14.491248 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e28dcdb2-0bbd-4e0f-af74-3a6a2ecc3e51 req-bd27edfb-da88-4c6c-ade4-2758050d73b0 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:14.491679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-e28dcdb2-0bbd-4e0f-af74-3a6a2ecc3e51 req-bd27edfb-da88-4c6c-ade4-2758050d73b0 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:14.504824 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-e28dcdb2-0bbd-4e0f-af74-3a6a2ecc3e51 req-bd27edfb-da88-4c6c-ade4-2758050d73b0 service nova] Creating event network-vif-plugged:b303352a-e74d-4248-bcda-cb4ae2df57bf for instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 on hv-cinder-85501 Aug 29 19:40:14.510584 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-e28dcdb2-0bbd-4e0f-af74-3a6a2ecc3e51 req-bd27edfb-da88-4c6c-ade4-2758050d73b0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035302 Aug 29 19:40:14.511217 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 596/1186] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:40:14.583571 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:14.591966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3d0367e2-f3ad-4b23-8e31-4a66242a54c9 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.172127 Aug 29 19:40:14.606188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 591/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:14 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:15.613532 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:15.614294 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:15.622140 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:15.622627 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:15.623055 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:15.623762 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:15.624237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:15.624653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:15.790057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:15.798815 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-4831687f-4571-4b59-adb5-b01ae751ad59 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1265 microversion: 2.1 time: 0.189576 Aug 29 19:40:15.799399 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 597/1188] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:15 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:40:16.821027 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:16.821719 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:16.828470 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:16.828947 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:16.829420 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:16.830063 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:16.830510 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:16.830931 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:16.978538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:16.986312 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-6edb9127-a723-46af-8133-a2704db51066 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1452 microversion: 2.1 time: 0.169994 Aug 29 19:40:16.986905 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 592/1189] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:16 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:17.007063 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:40:17.008314 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:40:17.015044 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:17.015529 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:17.015990 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:17.016692 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:17.017144 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:17.017571 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:17.156844 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:40:17.164696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-ca855941-10f3-4714-b8e2-29b1e6652ec7 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1452 microversion: 2.1 time: 0.161768 Aug 29 19:40:17.165272 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 598/1190] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:40:17 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:40:19.542604 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-bce45ec9-48a8-4a0b-9c8f-2cba27121621 req-55dfab3f-a059-4cd8-a0c2-0b21634a6237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8", "tag": "b303352a-e74d-4248-bcda-cb4ae2df57bf"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:40:19.553188 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-bce45ec9-48a8-4a0b-9c8f-2cba27121621 req-55dfab3f-a059-4cd8-a0c2-0b21634a6237 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:40:19.553670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-bce45ec9-48a8-4a0b-9c8f-2cba27121621 req-55dfab3f-a059-4cd8-a0c2-0b21634a6237 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:40:19.559590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-bce45ec9-48a8-4a0b-9c8f-2cba27121621 req-55dfab3f-a059-4cd8-a0c2-0b21634a6237 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:40:19.566616 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-bce45ec9-48a8-4a0b-9c8f-2cba27121621 req-55dfab3f-a059-4cd8-a0c2-0b21634a6237 service nova] Creating event network-changed:b303352a-e74d-4248-bcda-cb4ae2df57bf for instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 on hv-cinder-85501 Aug 29 19:40:19.572325 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-bce45ec9-48a8-4a0b-9c8f-2cba27121621 req-55dfab3f-a059-4cd8-a0c2-0b21634a6237 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034076 Aug 29 19:40:19.573061 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 593/1191] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:42:09.357928 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bb2d82f-eed0-4270-9031-ddd6aea7ddb1] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 19:42:09.358599 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:42:09.359314 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG dbcounter [-] [121336] Writing DB stats nova_cell1:SELECT=54 {{(pid=121336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:42:09.360190 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:09.361189 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:09.363771 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_api:SELECT=25 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:42:09.364775 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG dbcounter [-] [121337] Writing DB stats nova_cell1:SELECT=57 {{(pid=121337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:42:09.365764 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-95fc0811-b187-4841-a5cb-8d56e8b7e5ed req-53aff881-39fc-4876-a235-6d25d2a11af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8", "tag": "b303352a-e74d-4248-bcda-cb4ae2df57bf"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:42:09.374193 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:09.374930 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:09.375679 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:09.376538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-95fc0811-b187-4841-a5cb-8d56e8b7e5ed req-53aff881-39fc-4876-a235-6d25d2a11af0 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:09.376941 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:09.377072 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-95fc0811-b187-4841-a5cb-8d56e8b7e5ed req-53aff881-39fc-4876-a235-6d25d2a11af0 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:09.377582 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-95fc0811-b187-4841-a5cb-8d56e8b7e5ed req-53aff881-39fc-4876-a235-6d25d2a11af0 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:09.378304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:09.378969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:09.390077 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-95fc0811-b187-4841-a5cb-8d56e8b7e5ed req-53aff881-39fc-4876-a235-6d25d2a11af0 service nova] Creating event network-changed:b303352a-e74d-4248-bcda-cb4ae2df57bf for instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 on hv-cinder-85501 Aug 29 19:42:09.396744 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-95fc0811-b187-4841-a5cb-8d56e8b7e5ed req-53aff881-39fc-4876-a235-6d25d2a11af0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040176 Aug 29 19:42:09.397883 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 594/1192] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:42:09.414318 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Going to try to terminate instance {{(pid=121337) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:42:10.094221 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-7d989823-1af4-46f8-aa82-2ddd8ea030e6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 204 len: 0 microversion: 2.1 time: 0.739490 Aug 29 19:42:10.103199 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 599/1193] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:42:09 2022] DELETE /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:42:10.105169 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:10.106113 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:10.114180 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:10.114680 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:10.115219 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:10.115897 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:10.116412 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:10.116913 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:10.369498 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bb2d82f-eed0-4270-9031-ddd6aea7ddb1] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 36492. Aug 29 19:42:10.547908 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:10.563271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-297c6db8-677d-4624-89a5-4313e68e7f34 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1576 microversion: 2.1 time: 0.455777 Aug 29 19:42:10.563271 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 595/1194] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:10 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1576 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:11.579103 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:11.579806 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:11.586555 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:11.587097 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:11.587535 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:11.588277 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:11.588725 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:11.589151 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:11.731289 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:11.739738 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-2daaefde-afb6-44b6-8afc-ee98fbce5f1f tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1458 microversion: 2.1 time: 0.164945 Aug 29 19:42:11.740346 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 600/1195] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:11 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:12.678150 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-550afdfa-3980-4999-b9cd-95abfd40f944 req-79383012-4fef-4a7f-9429-8a90dfa3691c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8", "name": "network-vif-deleted", "tag": "b303352a-e74d-4248-bcda-cb4ae2df57bf"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:42:12.689238 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-550afdfa-3980-4999-b9cd-95abfd40f944 req-79383012-4fef-4a7f-9429-8a90dfa3691c service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:12.692318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-550afdfa-3980-4999-b9cd-95abfd40f944 req-79383012-4fef-4a7f-9429-8a90dfa3691c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:12.692318 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-550afdfa-3980-4999-b9cd-95abfd40f944 req-79383012-4fef-4a7f-9429-8a90dfa3691c service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:12.703838 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-550afdfa-3980-4999-b9cd-95abfd40f944 req-79383012-4fef-4a7f-9429-8a90dfa3691c service nova] Creating event network-vif-deleted:b303352a-e74d-4248-bcda-cb4ae2df57bf for instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 on hv-cinder-85501 Aug 29 19:42:12.709461 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-550afdfa-3980-4999-b9cd-95abfd40f944 req-79383012-4fef-4a7f-9429-8a90dfa3691c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035548 Aug 29 19:42:12.710113 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 596/1196] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:42:12.761223 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:12.766713 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:12.768573 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:12.769057 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:12.769494 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:12.770216 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:12.770672 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:12.772088 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:12.835531 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:12.843653 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8f760f66-6e44-4a95-bd3c-12f4f6205cee tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1390 microversion: 2.1 time: 0.086453 Aug 29 19:42:12.844257 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 601/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:12 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:13.868232 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:13.868860 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:13.874990 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:13.875466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:13.875915 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:13.876606 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:13.877053 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:13.877524 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:13.909755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:13.910237 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:13.910670 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:13.911109 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.objects.instance [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lazy-loading 'fault' on Instance uuid 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 {{(pid=121336) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:42:13.953209 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:13.961311 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-3f2f3164-461a-4e21-a940-a20eea171425 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 200 len: 1229 microversion: 2.1 time: 0.098912 Aug 29 19:42:13.961900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 597/1198] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:13 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:14.983010 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:14.983626 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:14.990657 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:14.991337 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:14.991969 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:14.993697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:14.993697 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:14.994143 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:15.010081 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] HTTP exception thrown: Instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 could not be found. Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Request method failure captured: Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 HTTP/1.1 Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRTFOZPj7yKmKtITRG_BVuAO9eRURfJ38vUlVQ_eFFoQwmOZwTFjR7GbjMnGVOnmpac3CGz3y7TSVaBbenaeH79PHtOMtHErGRWciV_mR3CHhX7gsfMiX-2m62A4rMJD1emDPMryLY-uiK3Y_4KObPoCGC8GMbFxkgl_PV9ali362To Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:42:15.012110 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f253ee21c29a44b4bfee93f14c26a2d5"}]}] Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: a504697c696e4d8392adf0ae8adf98a7 Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 could not be found. Aug 29 19:42:15.014696 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': '4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8'} Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 could not be found. Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:42:15.015872 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 could not be found. Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 could not be found. Aug 29 19:42:15.017606 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:15.019575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Returning 404 to user: Instance 4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:42:15.019575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-03661234-191b-49b0-8e34-f1676c26d3d6 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8" status: 404 len: 111 microversion: 2.1 time: 0.034806 Aug 29 19:42:15.019575 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 602/1199] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:14 2022] GET /compute/v2.1/servers/4aff7bd0-2d3b-45a2-9220-3c1f1ca410f8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:42:18.964943 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:18.965538 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:18.966027 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [req-db2acc0b-c473-423a-81c5-3e76e1c9a824 req-84593d31-b2aa-4820-af0e-c6370855ef98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2198896-a469-4d0e-b382-c97b1998f447", "tag": "029cad2e-8180-43aa-afc6-5d8cf11a9ebd"}]} {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:42:18.977415 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:18.977674 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-db2acc0b-c473-423a-81c5-3e76e1c9a824 req-84593d31-b2aa-4820-af0e-c6370855ef98 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:18.978191 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-db2acc0b-c473-423a-81c5-3e76e1c9a824 req-84593d31-b2aa-4820-af0e-c6370855ef98 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:18.978638 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:18.978770 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [req-db2acc0b-c473-423a-81c5-3e76e1c9a824 req-84593d31-b2aa-4820-af0e-c6370855ef98 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:18.979466 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:18.980359 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:18.981076 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:18.981729 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:18.993260 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.compute.server_external_events [req-db2acc0b-c473-423a-81c5-3e76e1c9a824 req-84593d31-b2aa-4820-af0e-c6370855ef98 service nova] Creating event network-changed:029cad2e-8180-43aa-afc6-5d8cf11a9ebd for instance e2198896-a469-4d0e-b382-c97b1998f447 on hv-cinder-85501 Aug 29 19:42:19.002067 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [req-db2acc0b-c473-423a-81c5-3e76e1c9a824 req-84593d31-b2aa-4820-af0e-c6370855ef98 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039577 Aug 29 19:42:19.004422 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 603/1200] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:42:19.019269 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Going to try to terminate instance {{(pid=121336) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:42:19.629966 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-1fa74ac4-a546-46ae-ad60-abd61a95384a tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 204 len: 0 microversion: 2.1 time: 0.668800 Aug 29 19:42:19.630481 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 598/1201] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:42:18 2022] DELETE /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:42:19.639507 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:19.640283 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:19.647336 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:19.647945 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:19.648481 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:19.649282 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:19.649818 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:19.650338 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:19.820830 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:19.823778 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-1e115ce4-8ce0-4b0e-b22f-5c97982c6b20 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1578 microversion: 2.1 time: 0.188493 Aug 29 19:42:19.824403 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 604/1202] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:19 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:20.846827 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:20.847519 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:20.854115 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:20.854590 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:20.855017 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:20.855709 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:20.856264 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:20.856681 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:21.002155 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.policy [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121336) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:21.010873 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-57b1bb5b-afc5-4fb5-8284-d4aa10114d30 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1460 microversion: 2.1 time: 0.168123 Aug 29 19:42:21.011389 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 599/1203] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:20 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1460 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:22.031724 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:22.032345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:22.039476 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:22.039983 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:22.040416 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:22.041237 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:22.041683 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:22.042129 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:22.131430 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:22.140019 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-c9b6b765-c57c-400d-9c9c-32f13cfe5c8c tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1392 microversion: 2.1 time: 0.112164 Aug 29 19:42:22.140640 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 605/1204] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:22 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1392 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:22.169800 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [req-8a457407-f320-4f83-b33c-f6a0d14dfc05 req-d5a319bb-65b3-46d3-a2a0-a64b591c0b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2198896-a469-4d0e-b382-c97b1998f447", "name": "network-vif-deleted", "tag": "029cad2e-8180-43aa-afc6-5d8cf11a9ebd"}]} {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:42:22.185560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-8a457407-f320-4f83-b33c-f6a0d14dfc05 req-d5a319bb-65b3-46d3-a2a0-a64b591c0b74 service nova] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:22.185560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-8a457407-f320-4f83-b33c-f6a0d14dfc05 req-d5a319bb-65b3-46d3-a2a0-a64b591c0b74 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:22.185560 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [req-8a457407-f320-4f83-b33c-f6a0d14dfc05 req-d5a319bb-65b3-46d3-a2a0-a64b591c0b74 service nova] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:22.196081 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.compute.server_external_events [req-8a457407-f320-4f83-b33c-f6a0d14dfc05 req-d5a319bb-65b3-46d3-a2a0-a64b591c0b74 service nova] Creating event network-vif-deleted:029cad2e-8180-43aa-afc6-5d8cf11a9ebd for instance e2198896-a469-4d0e-b382-c97b1998f447 on hv-cinder-85501 Aug 29 19:42:22.201634 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [req-8a457407-f320-4f83-b33c-f6a0d14dfc05 req-d5a319bb-65b3-46d3-a2a0-a64b591c0b74 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Aug 29 19:42:22.202536 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 600/1205] 10.222.0.62 () {64 vars in 1317 bytes} [Mon Aug 29 19:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:42:23.161856 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:23.162481 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:23.168966 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:23.169449 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:23.170984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:23.170984 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:23.171220 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:23.171526 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:23.207084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:23.207084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:23.207084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:23.207084 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.objects.instance [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lazy-loading 'fault' on Instance uuid e2198896-a469-4d0e-b382-c97b1998f447 {{(pid=121337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:42:23.248275 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.policy [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a504697c696e4d8392adf0ae8adf98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f253ee21c29a44b4bfee93f14c26a2d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121337) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:42:23.258143 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-3c3d465f-8fc1-4891-b246-7d3a2564891e tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 200 len: 1230 microversion: 2.1 time: 0.100134 Aug 29 19:42:23.259002 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 606/1206] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:23 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:42:24.280841 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:24.281601 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e2198896-a469-4d0e-b382-c97b1998f447] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:24.289892 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:24.291628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:24.291628 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:24.292054 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:24.292602 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:24.293026 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:24.307668 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] HTTP exception thrown: Instance e2198896-a469-4d0e-b382-c97b1998f447 could not be found. Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Request method failure captured: Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 HTTP/1.1 Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRTFOZPj7yKmKtITRG_BVuAO9eRURfJ38vUlVQ_eFFoQwmOZwTFjR7GbjMnGVOnmpac3CGz3y7TSVaBbenaeH79PHtOMtHErGRWciV_mR3CHhX7gsfMiX-2m62A4rMJD1emDPMryLY-uiK3Y_4KObPoCGC8GMbFxkgl_PV9ali362To Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:42:24.309566 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f253ee21c29a44b4bfee93f14c26a2d5"}]}] Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: a504697c696e4d8392adf0ae8adf98a7 Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance e2198896-a469-4d0e-b382-c97b1998f447 could not be found. Aug 29 19:42:24.312514 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'e2198896-a469-4d0e-b382-c97b1998f447'} Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2198896-a469-4d0e-b382-c97b1998f447 could not be found. Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:42:24.314303 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2198896-a469-4d0e-b382-c97b1998f447 could not be found. Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2198896-a469-4d0e-b382-c97b1998f447 could not be found. Aug 29 19:42:24.317405 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.320233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Returning 404 to user: Instance e2198896-a469-4d0e-b382-c97b1998f447 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:42:24.320233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-432f641f-2adf-4a69-b17f-f4f099293065 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447" status: 404 len: 111 microversion: 2.1 time: 0.034558 Aug 29 19:42:24.320233 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 601/1207] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:24 2022] GET /compute/v2.1/servers/e2198896-a469-4d0e-b382-c97b1998f447 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:42:24.858499 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:24.859070 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.compute.api [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121337) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:24.866345 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:24.866827 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:24.867329 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:24.868304 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:24.868754 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:24.881037 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG oslo_concurrency.lockutils [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:24.884056 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.wsgi [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] HTTP exception thrown: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Request method failure captured: Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: request: DELETE /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 HTTP/1.1 Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept: application/json Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Accept-Encoding: identity Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Connection: close Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Length: 0 Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Content-Type: application/json Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Host: 10.222.0.62 Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: Openstack-System-Scope: None Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: User-Agent: python-urllib3/1.26.12 Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Auth-Token: gAAAAABjDRTFOZPj7yKmKtITRG_BVuAO9eRURfJ38vUlVQ_eFFoQwmOZwTFjR7GbjMnGVOnmpac3CGz3y7TSVaBbenaeH79PHtOMtHErGRWciV_mR3CHhX7gsfMiX-2m62A4rMJD1emDPMryLY-uiK3Y_4KObPoCGC8GMbFxkgl_PV9ali362To Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Id: None Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Domain-Name: None Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Identity-Status: Confirmed Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Is-Admin-Project: True Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Id: default Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Domain-Name: Default Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Project-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Role: member,reader Aug 29 19:42:24.885820 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Roles: member,reader Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f253ee21c29a44b4bfee93f14c26a2d5"}]}] Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Id: default Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Domain-Name: Default Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Id: a504697c696e4d8392adf0ae8adf98a7 Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: X-User-Name: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: method: > Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: exception: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.887525 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: action_args: {'id': 'e4881f7f-3ff5-4baa-aec0-a1ab437eea32'} Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:42:24.888609 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.890281 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.892692 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Returning 404 to user: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. {{(pid=121337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:42:24.892692 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-8f985fa9-4f59-4c81-b1f3-e305f402f269 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 404 len: 111 microversion: 2.1 time: 0.032805 Aug 29 19:42:24.892692 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 607/1208] 10.222.0.62 () {58 vars in 1239 bytes} [Mon Aug 29 19:42:24 2022] DELETE /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:42:24.899293 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '>' {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:24.899925 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.compute.api [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] [instance: e4881f7f-3ff5-4baa-aec0-a1ab437eea32] Fetching instance by UUID {{(pid=121336) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:42:24.906002 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:24.906477 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:24.906900 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:24.907630 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Acquiring lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:42:24.908103 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:42:24.908539 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG oslo_concurrency.lockutils [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Lock "e2b8211c-8acf-4e46-aadb-2cdee030a23c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121336) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:42:24.927197 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.wsgi [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] HTTP exception thrown: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Request method failure captured: Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: request: GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 HTTP/1.1 Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept: application/json Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Accept-Encoding: identity Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Connection: close Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Length: 0 Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Content-Type: application/json Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Host: 10.222.0.62 Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: Openstack-System-Scope: None Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: User-Agent: python-urllib3/1.26.12 Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Auth-Token: gAAAAABjDRTFOZPj7yKmKtITRG_BVuAO9eRURfJ38vUlVQ_eFFoQwmOZwTFjR7GbjMnGVOnmpac3CGz3y7TSVaBbenaeH79PHtOMtHErGRWciV_mR3CHhX7gsfMiX-2m62A4rMJD1emDPMryLY-uiK3Y_4KObPoCGC8GMbFxkgl_PV9ali362To Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Id: None Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Domain-Name: None Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Identity-Status: Confirmed Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Is-Admin-Project: True Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Id: default Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Domain-Name: Default Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Project-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Role: member,reader Aug 29 19:42:24.928777 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Roles: member,reader Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f253ee21c29a44b4bfee93f14c26a2d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f253ee21c29a44b4bfee93f14c26a2d5"}]}] Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Id: f253ee21c29a44b4bfee93f14c26a2d5 Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-Tenant-Name: tempest-TestVolumeBootPattern-2087782788 Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Id: default Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Domain-Name: Default Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Id: a504697c696e4d8392adf0ae8adf98a7 Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: X-User-Name: tempest-TestVolumeBootPattern-2087782788-project Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: method: > Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: exception: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.930880 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: action_args: {'id': 'e4881f7f-3ff5-4baa-aec0-a1ab437eea32'} Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: {{(pid=121336) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:42:24.932010 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. Aug 29 19:42:24.933755 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: ERROR nova.api.openstack.wsgi Aug 29 19:42:24.935584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: DEBUG nova.api.openstack.wsgi [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Returning 404 to user: Instance e4881f7f-3ff5-4baa-aec0-a1ab437eea32 could not be found. {{(pid=121336) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:42:24.935584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: INFO nova.api.openstack.requestlog [None req-a188c7e8-9bff-4824-99c7-906fc17f5db3 tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32" status: 404 len: 111 microversion: 2.1 time: 0.036020 Aug 29 19:42:24.935584 dv-cinder-855013-1-iscsi devstack@n-api.service[121336]: [pid: 121336|app: 0|req: 602/1209] 10.222.0.62 () {58 vars in 1236 bytes} [Mon Aug 29 19:42:24 2022] GET /compute/v2.1/servers/e4881f7f-3ff5-4baa-aec0-a1ab437eea32 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:42:26.664763 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: DEBUG nova.api.openstack.wsgi [None req-d7d753b0-6182-4a03-a3f9-82f304385ccc tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] Calling method '.version_select at 0x7f1fde5c0d30>' {{(pid=121337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:42:26.803039 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: INFO nova.api.openstack.requestlog [None req-d7d753b0-6182-4a03-a3f9-82f304385ccc tempest-TestVolumeBootPattern-2087782788 tempest-TestVolumeBootPattern-2087782788-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-217659503" status: 202 len: 0 microversion: 2.1 time: 0.142049 Aug 29 19:42:26.803628 dv-cinder-855013-1-iscsi devstack@n-api.service[121337]: [pid: 121337|app: 0|req: 608/1210] 10.222.0.62 () {58 vars in 1260 bytes} [Mon Aug 29 19:42:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-217659503 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)